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ABSTRACT 

To develop guidelines for the optimum use of 
computerized training systems in the Army, data related to computer 
based training were analyzed, including the results of a feasibility 
study and the results of comparative 'studies on student achievement, 
attrition, and attitudes. Three issues were addressed: (1) the 
effectiveness of computer based education (CBI) versus conventional 
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information on the study, a description of research methodology, and 
a summary of recommendatj.cns. (EMH) 



****** ********************** 

* Documents acquired by ERIC include many informal unpublished * 

* materials not available from other sources. ERIC makes every effort * 

* to obtain the best copy available. Nevertheless, items of marginal * 

* reproducibility are often encountered and this affects the quality * 

* of tho microfiche and hardcopy reproductions ERIC makes available * 

* via the ERIC Document Reproduction Service (EDRS) . EDRS is not * 

* responsible for the quality of the original document. Reproductions * 

* supplied by EDRS are the best that can be made from the original* * 
*********************************************************************** 



EKLC 



rM 

1 — I 

CD 
LU' 

Guidelines for Optimum Utilization of Computerized Training 
Systems as Based on an Analysis and Evaluation 
ot' Such Programs in the U. S. Army 



ALEXANDER A. LONGQ 



O 

ft 



A MAJOR APPLIED RESEARCH PROJECT 
PRESENTED IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR 
THE DEGREE OF DOCTOR OF EDUCATION 



NOVA UNIVERSITY 
1976 



u s 06P»"TMENTOFHEALTH. 
E0UC*T10N»VVELFABE 
NATIONAL INSTITUTEOF 
EDUCATION 




Dedicated 
to 

Jane 

Alex 
Charles 
Darryl 

This project could not have been completed without the moral support 
and devotion to duty of my wife and typist, June, and my children, Alex. 
Charles and Darryl who, though too young to understand the demands upon 
my time which this project took, were v:;ry patient and understanding. I 
am grateful to them particularly and so many others, family members and 
close colleagues, for their incentive to make this possible. 



3 



ii 



ABSTRACT 

The purpose of this Major Applied Research Project was to develop 
guidelines and recommendations for optimizing the utilization of comput- 
erized training systems through the conduct of an intensive analysis and 
evaluation of the Army's empirical data base related to computer-baB«d 
training. Including a feasibility study, a number of in-house investigations 
yielded a plethora of data concerning the impact of computer-based instruc- 
tion (CBI) on student achievement, attrition, attitudes and o'.her performance 
criteria. This data was derived from several tests and evaluation of two 
different computer-based instructional s'^stems: the IBM 1 500 Instruction- 
al System and the PLATO IV Computer-based Educational System, The 
former system was located completely on site; the latter consisted of PLA- 
to IV terminals which were interfaced via telecommunication link with a 
large central processor at the University of Illinois. Emphasis in the a- 
nalysis and synthesis of the data was focused on their operational implica- 
tions for optimum use of such systems. 

Three major issues, with a number of associated questions, were ad- 
dressed in this project. Issue A pertained to the replicability of effective- 
ness as regards CBI vs CI (computer-based vs conventional instruction); 
Issue B pertained to the replicability of effectiveness as regards CBI^jVs 
CBI^2) (the two subject CBI Systems considered); and. Issue C pertained to 
the factors and relationships unique to CBI. Apropos each of these issues 
and their subsidiary questions* emphasis was pla.ced on: immediate infer- 
ences (stated as guidelines) relevant to optimizing CBI operationally; and, 
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heuristic CBI afipectK (fitatecl as recomtnendations) suggesting further re- 
quired research. 

The procec^ures and niethodology for assessing the above major issues 
and their allied questions engaged more than one method of research. Over- 
all, the naturalistic training setting was kept intact, and the general re- 
search methodology was quasi- experimental. This was particularly the 
case for Issues A/B, considering the operational context of the two CBI 
systems. However, Issue C appropriately engaged the correlational meth- 
od (utilizing both simple /multipl e regression) in determining relationships 
unique to CBI. The information sources for this project consisted of the 
data bank of information derived from an initial feasibility study and six 
follow-up CBI studies conducted in-house by this writer. In their entirety, 
these studies contained a representative cross section of Army enlisted 
students, Military Occupational Specialties, and technical course material. 
A variety of CBI effectiveness criteria were employed including: achieve- 
ment (written/performance), attrition, time-to-complete and attitude. 

Statistical analysis regarding the above major issues and their relat- 
ed questions consisted of an array of descriptive and inferential statistics 
as the respective independent-dependent variables dictated. Included, as 
appropriate, were the standard descriptive statistics; the classic parame- 
tric nonparametric tests of statistical significance; and indices of simple 
and multiple regression. 

Based on a series of investigations, the results on Issue A, . pertaining 
to a test of the replicability of CBI (consisting of computer assisted instruc- 
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tion mostly with some computer managed instruction) as compared to con- 
ventional instruction (CI), were highly positive for CBI. Without any ecjuiv- 
ocation, the basic findings in the Army's initial CBI feasibility study, com- 
paring CAI/CMI with CI, were replicated across several interim and a 
final summative evaluation. The findings were: that CDI students demon- 
strated equivalent or greater achievement, on average, than CI students and 
attained this in significantly less time. Secondly, the results on Issue B, 
regarding stud:?nt attitudes /opinions toward CBI, were likewise highly pos- 
itive toward CBI. The overall finding of the general- specif ic attitude re- 
sults was that CBI was significantly favored by students for training pur- 
pK>ses. Further, a number of substantive and constructive comments were 
elicited from students on a broad array of CBI parameters. Lastly, the 
results on Issue C, pertaining to factors and relationships indigenous to 
CBI, consistently supported the value of multiple regression analysis as a 
valuable tool for maximizing predictions of training performance/success. 
Also, the recurring identification of attitude toward CBI as an added pre- 
dictor of performance underscored its value in CBI. 

Based on the results and experiences of this project, 22 operational 
guidelines and 17 research recommendations were derived for purposes of 
optimizing the use of CBI. Both the guidelines and recommendations ad- 
dressed a variety of gene ral / specific topics of current operational interest: 
physical learning conditions, instructional methodology, instructor support, 
student motivation/performance^ peer /individual learning and computer 
generated graphics. The research recommendations represent heuristic 
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conaiderationn on further devclopmc-in and exploration to help bridge the 
"gap" between the current statue of GDI and its future directions. The 
broader implications of the overall findings of this Major Applied Research 
Project on CRI are manifold and of significance not just for Tri-service 
training but across the entire education community. 
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I TITLE 

Guidelines for Optimum Utilization of Computerized 
Training Systems as Eased on an Analysis and Eval- 
uation of Such Programs in the U.S. Army 

II PURPOSE 

The purpose of this project is to develop guidelines and recommen- 
dations for the optimum utilization of computerized training systems through 
the conduct of an intensive analysis and evaluation of the Army^s empirical 
data base related to computer-based training. 
Ill BACKGROUND 

A. THE PROBLEM 

The introduction of computers in U.S. Army training was based on 
their high promise to provide more cost-effective training without detriment 
to the quality of training. As the result of a strong impetus from the Sec- 
retary of Defense (1965) for educational innovation including increased 
research and development and new methods and techniques the U5. Army 
has been engaged in the development and testing of computer-based methods 
of instruction. Due to the high potential cost expenditure incident to com- 
puterized training systems and their impact on the traditional *'modus 
operandi'* in Army training methodology, it was decided from the outset 
that this teaching-learning ii.novation would be subjected to a rigorous eval- 
uation of its feasibility, viability, and effectiveness prior to any extensive 
implementation. Subsequent to an initial feasibility study (IBM, 1968), a 
series of phased and special evaluations was conducted (Longo, 1969, 1972a, 
1972b, 1975) to assess the merits of this new mode of instruction in teaching 

o 

ERIC 



2 

Army Basic Electronics Fundamentals and related subject matter. These 
studies have yielded a plethora of data concerning student achievement, 
attrition, attitudes and other performance criteria via both computerized 
and conventional Army classroom instruction. Much of this valuable data, 
based upon a test and evaluation of two different computer-based instruc- 
tional systems, has gone unreported. Due to the constraints of time and 
other administrative exigencies, a complete analysis and synthesis of all 
empirically obtained data for its operational implications, not just go - 
no-go decision-making pertaining to computer-based instruction (CBI), 
has not been possible. Through such an analysis and synthesis, this pro- 
ject will provide a set of empirically based guidelines for the optimum use 
of computer-ba^ed instruction, a,nd recommendations for further research 
required in thi? area. 

B, REVIEW OF THE LITERATURE 

The introduction of the computer into the educational process per se 
was a natural coupling based upon the unlimited ne^ds at all levels of edu- 
cation for information transmission and management on the one hand and 
the almost unlimited potential of the modern digital computer for infor- 
mation processing on the other hand. Historically, the role of computers 
in education was the result of evolutionary technological developments 
within the fields of both computers and education. Within the domain of 
education this evolutionary process included major developments in systems 
engineering, individualized instruction and teaching machines; and, within 
the field of computers, it included major breakthroughs in interactive 
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terminal systems (hardware) and improved author programming languages 
(software). Although a full historical etiology of events in both education 
and computers is beyond the purposes and scope of this project, an over- 
view of the evolution of computers in education at large, and within the 
U.S. Army specifically, is presented below. The use of computers in the 
teaching process is a matter of intense interest and concern not only to 
educators in general, but the U.S. Army particularly, as well. Therefore, 
the general context and influences within which education and computers 
evolved to yield computer-based education (CBE) are outlined in section 
B-1, and the specific factors contributing to the development of computer- 
based instruction (CBI) in the U.S. Army are delineated in section B-Z 
below. 

1. General 

a. Predisposing Educational Developments 

(1) Systems Eng^ineering. The influence which systems engi- 
neering exerted upon modern education has been significant and far-reaching. 
Ultimately, as will be discussed later, the current trend toward computers 
in education can be traced to the pervasive influence of systems engineering. 
As with other similar innovations, the roots of systems engineering run deep. 
Herrscher (1973) indicates that: "Although the systems approach to instruc- 
tion is a comparatively new concept to many educators, it does not repre- 
sent new thinking. Ralph Tyler conceptualized such an approach to instruc- 
tion as early as 1935 (p. 16)." It continues to be a pervasive influence 
throughout modern educational and instructional innovations. 
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The systems approach to instruction is not a teaching method per se 
but a meta-method within which a variety of instructional modes can be 
incorporated, particularly those which are characteristically individualized 
and self-paced, such as computer-based instruction. Attesting to this fact, 
selected examples of instructional systems employed by the military, 
industry and academia. respectively, are illustrated below. These pro- 
vide an adequate c ro s s- sectional view of educational systems engineering 
in action. The U.S. Army Signal Center and School (currently the U.S. 
Army Con aunication Electronics School), Fort Monmouth, New Jersey, 
(Evaluation Division, 1970); the Education and Training Company (Silvern, 
197Z); and, the New York Institute of Technology (Schure, 1965, 1971) are 
representative selections. 

The Army's systems approach is based on an official regulation 
(TRADOC, 197Z), pertaining to Systems Engineering of Training, requires 
that all courses be systems engineered. The systems concepts adopted for 
course design include: (a) job analysis; (b) task inventory; (c) training 
objectives; (d) plan of instruction; (e) performance testing; and, (f) feed- 
back. The main thrust is measurement and feedback to insure that course 
content is tied to job relevant tasks. 

Silvern (1972) clearly describes his systems approach as: " a 

process consisting of four major parts: (a) analysis; (b) synthesis;(c) mod- 
eling; and, (d) simulation (p. 9)." These steps are termed anasynthesis 
which is a metamodel generali zabl e to all systems. 
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Schure (1965, 1971) provided both a conceptualized and a pragmatic 
systems approach for the development, implementation and evaluation of 
instruction* Based upon the fundamental principles of systems engineer- 
ing, Schure (1965) describes the development of a model system for the 
education of engineering technicians. This provided the basis for the 
development of Project ULTRA (Unlimited Training for All), which 
incorporates an analysis of the numerous facets and problems of educ ation 
and provides an integrated solution which is orderly, accepts special cues, 
and matches the needs of the individuals to the requirements of society 
(p«371)*" In order to achieve this systems goal, it was emphasized that 
each individual must progress at his own rate of learning. One pragmatic 
extension of this model system is represented by the Automated Instruc- 
tional Management System (AIMS) as described by Schure (1971), Succinctly 
in classic systems fashion: "ALMS consisted of carefully specifying three 
sets of conditions: (a) Desired outcomes or objectives of the system; (b) 
A detailed audit of the characteristics of the system, the system inputs . , 
(c) An explicit description of relevant means-ends relationships and methods 
for assessing efficiency ^.nd/cr efficacy, , , (p. 31), 

The above works are representative of a very successful transference 
of systems engineering to current instructional methodology. This move- 
ment provided fertile foundation wherein individualized instruction and 
teaching machines, to be discussed next, found abundant nurture. Regard- 
ing the broader relevance of the systems approach to computer-based 
education. Silvern (1967) argues convincingly that: " The invention of the 
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instructional syst^^m as a subset of systems engineering, coupled with the 
invention of the learner- centered conceptualization, may turn out to form 
a combination of events which makes CAI, computer assisted instruction, 
a reality and not merely a learning research curiosity. . . . and the cor*cept 
of system constitute the true foundation for CAI of the present. . . . and of 
the future (p. 82). 

(2) Individualized Ingtruction. Within the field of education the 
concept of individualized Instruction has perennially projected a mystique 
having high intuitive value. A tutor for every student has been an elusive 
ideal throughout the entire history of education. The concept of individual 
tutors dates back to the era of Confuscius, Aristotle, Plato, and Socrates 
who recognized the fact of individual variabilities. Blake and McPherson 
(1973) trace the history of individualized instruction through the middle 
ages and into modern times, referencing the humanistic individualism of 
Rousseau; the revolutionary psychometric advances in measuring individ- 
ual differences by Binet; and the idiosyncratic approach in relating to each 
child by Montessori. Traditionally, of course, America has made a hall- 
mark of individuality and independence. For reasons of sheer expediency, 
however, it evolved that grouped instruction {teaching to the class mean) 
was more efficient in administering and coping with mass education. Re- 
cently, due to advances in instructional methods and strategies, the tide 
has turned toward catering to individual educational needs. Instructional 
innovations now make it feasible for students to learn on their own in a 
self-paced mode. The teacher has not been eliminated but rather his role 
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is being converted to being a tutor or guide. 

In recent years, a wave of individualized instructional methodr has 
flooded the educational community and continues to do so. These methods 
are highly compatible and readily complement and extend the concepts of 
the systems approach to education, and serve to make existing educational 
practice conducive to applications of computer-based education. Cooley 
and Glazer (1969) define individualized education as the adaptation of 
instructional practices to individual requirements. The link or mechanism 
by which this adaptation is most efficiently effected is systems engineering 
of instructional material: i.e., defining terminal performance objectives; 
identifying individual learner capabilities and needs; selecting suitable 
educational strategy alternatives per individual; revising system based on 
information feedback; and so forth. Most noteworthy, relative to computer- 
based instruction, is that individualized instruction lends itself to various 
degrees of automation, including total computerization of instruction. 

Again, providing a cross- sectional view of individualized instruction 
in action, sf>lected examples of its use by the military, industry ^.nd aca- 
demia are cited below. The three representative examples respectively 
relate to: the U.S. Personnel Research Activity. San Diego, California 
(Harding and Fleishman, 1967); American Institutes for Research and the 
Westinghouse Learning Corporation, jointly (Flannagan, 1971); and. Nova 
High School^ an educational research and development center for the 
Broward County Board of Public Instruction, Broward County, Florida 
(Arena, 1970). 2 1 
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The Naval Air Technical Training Command, since the early sixties, 
has sponsored a judicious use o|<individualized instruction in the form of 
programmed instruction (PI). Typically, its approach has been to employ 
PI specifically where it most appears advisable to use it and not necessarily 
program the entire course of instruction. Harding and Fleishman (1967) 
provide supportive findings for PI and indicate that group attitude toward 
it to be favorable. This form of individualized instruction was a logical 
step in the evolution of instructional methodology and has gained wide accep- 
tance by the military services. 

On a more elaborate scale, Project PLAN (Program for Lc-r^rning 
inAccordance withNeeds) represents a systems effort by the American 
Institutes for Research and the Westinghouse Corporation to design and 
implement a complete individualized instruction program. Based on the 
results of Project TALENT, a survey of nearly a half million students. 
Project PLAN emphasized the need to assist the individual to adjust to the 
world in which he lives. Flanagan (1971) indicated that, based on several 
years of implementation, PLAN does make possible individualized instruc- 
tion to students on a large scale. 

In an attempt to provide an effective instrument for effecting individ- 
ualized instruction, eight educators, funded by the U.S. Office of Education 
under a Title III grant, worked on the Interrelated Mathematics Science 
(IMS) Project, based at the Nova High School, Broward County, Florida. 
Arena (1970) and Cardarelli (1972) both concur that a viable vehicle for 
making individualized instruction a reality is the learning Activity Package 
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(LAP). The LAP was conceived and developed at Nova high schooL Its 
function is to guide the student through a highly structured program of 
learning materials. The Nova High School IMS Project was highly suc- 
cessful and points the direction for greater use of individualized instruc- 
tion on both a limited and large scale. 

In summary, along with systems engineering, individualized instruc- 
tion represents another major evolutionary development within the domain 
of education which provides impetus toward full automation of instruction. 
As will be discussed later, both of these educational innovations precipitated 
the onset of computer-based instruction. However, as noted earlier, a 
third link in the evolutionary chain also contributed much to the generation 
of computer-based instruction. This was the teaching machine ^'boorn" 
which is discussed next. 

(3) Teaching Machines . A third major educational development 
giving great impetus to computer-based instruction was the *'boom*' in 
teaching machines. The vision of automating instruction achieved its first 
major breakthrough in the mid twenties with the work of Pressy (1926) at 
Ohio State University. He considered the education for the day to be des- 
titute of any labor saving mechanism. In order to remedy this situation, 
Pressy (1926) invented and built a teaching apparatus which could provide 
drill and practice, score tests, and efficiently teach. Thus, this device 
could be programmed to be used both for testing and teaching. It was pro- 
jected that the device could save many administrative hours used for drill 
and practice and scoring tests. Despite Pressy's creative ingenuity, the 
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teaching machine concept did not gain widespreaJ use until Skinner (1958) 
combined the principles of operant conditioning and a crusading personality 
to make teaching machines acceptable to the educational community. The 
Skinnerian teaching machine was uniquely different from prior machines. 
It provided immediate confirmation (reinforcement) of correct responses; 
insured that learning was achieved with elimination of'errors; and favored 
teaching via small incremental steps based on a linear arrangement of con- 
tent material. In essence, learning was accomplished by shaping of be- 
havior via short S-R conditioning frames, also called learning by approx- 
inflations. Skinner (quoted by Eysenck, 1966) concludes that machines 
• could be programmed to teach, in whole or in part, all the subjects 
taught in elementary and high school and many taught in college (p. 10). " 

Skinner's approach also has not been universally accepted. It is 
apparent that teaching machines represent the joint effect of machine tech- 
nology plus the instructional methodology incorporated within it. Ironically, 
just as Skinner raised questions about Pressy's hardware, so did others 
raise questions about Skinner's learning theory. Thus, in contrast with 
Skinner's small step linear method, Crowder preferred a large step branch- 
ing process whereby students could be advised and receive remediation as 
necessary. Skinner emphasized S-R conditioning; Crowder stressed inter- 
active responsiveness. 

The sixties saw an influx of teaching machines utilizing both adroit 
linear programming as well as scrambled branching. Gadgetry was ram- 
pant throughout all levels of education. However, inventions to solve one 
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set of problems havt! an "uncanny" way of fathering others. While most 
attention was focused upon hardware, little consideration was given to 
standardization of materials, program compatibility and machine inter- 
changeability, as noted by Fry (1963). The teaching machine "boom" 
verged on bursting. The inertia toward automated instruction, however, 
was not to be extinguished. As predisposing influences, systems engi- 
neering, individualized instruction and teaching machines ushered the 
computer into modern education. The stage was set and the timing was 
proper for the onset of computer-based instruction. Hall (1971) emphasizes 
that the computer has been hailed as tl:^* most obvious next step in solving 
the limitations of individualized adaptation of the programmed text and 
teaching machine. 

b. Predisposing Computer Developrn6!*nts 
Besides a favorable educational milieu, certain developments within 
the computer field itself hastened the arrival of computer-based instruction, 
particularly computer- as si sted instruction (CAI), consisting of interactive- 
terminal oriented instruction. In order that a CAI system could become a 
practical reality, three efficient hardware/software subsystems were re- 
quired: a powerful central- auxiliary processor system having adequate 
computational, manipulative, storage and retrieval capabilities; an effec- 
tive authoring language facilitating the development and debugging of instruc- 
tional materials; and, a practical cost-effective interactive terminal per- 
mitting human learner interface with the computer system. The three 
required subsystems relate to the three major users of a CBI system: 
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the systems proj^ramaicr, the instructional programmer, and the student. 
Fortunately, business and scientific demands provided the incentive for 
computer manufacturers to develop sufficiently powerful general purpose 
•'maxi" computers having auxiliary features amenable, with little modifi- 
cation, for initial applications of CAI. Currently, however, powerful 
dedicated minicomputers are also available for specific purpose use. Both 
types of computers appear sufficient for most CBI demands in the foresee- 
able future. Therefore, breakthrough developments in the latter two sub- 
systems, authoring language and student terminal, were necessary for CAI 
to become a reality. 

(1) Authoring Language . One of the most crucial components of 
a CAI system, and certainly the most volatile in the state of the art, is that 
of authoring language. Frye (1968) classified computer languages into four 
categories: (a) conventional compilers (FOR TP AN/COBOL) ; (b) adapted 
compilers (FOIL/CATO); (c) interactive computing and display (APL/BASIC); 
and. (d) special instructional authoring languages (COURSEWRITER /TUTOR / 
PLANIT). Respectively, the above are presented in a decreasing order of 
user difficulty and an increasing potential for CAI application. Hansen 
(1966) indicates three essential aspects of a CAI language which continue 
to hound l^,nguage developers: power, generality and reliability. Regarding 
these, power pertains to conceptual and economic efficiency (i. e. , commun- 
icating most with the least CPU coding per unit time); generality pertains 
to the applicability of the language to a wide range of instructional tasks; 
and , reliability refers to the internal consistency of the language to detect 
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logical ^^t^tional errors. The second evaluative area of ultimate 



importan^^^ to language design is its human factors appeal and accepta- 
bility by F^^^ntial users. Unless it can be readily learned and used it 
will suffc^ ^^tij^ction. Some success in authoring ease has been achieved 
With the C ^loprnent of the following CAI languages: COURSEWRITER, 
DIALOG, AL, iKFORM, LYRIC. TUTOR AND PLANIT (CONARC, 197Z). 
Oni- ^he authoring language problem was attacked for solutions, the 



( C 

number o^ Al languages proliferated. While each served the special 
purposes w}^ich designed and intended, again the attempted Golution 
bred anotl^ ^ p^obl^^ni. fhe new problem concerned compatibility among 
language^ j^^ichines. This impinges directly upon the transportability 

of instruc^^^i^a.! rnaterials which is of great importance particularly within 
and arrion^ tri- services. Zinn (1972) notes over 40 instructional 
languages developed. Ma ny more have been born since then. 

The probJ^^ of compatil:jiiity among languages and machines is an increas- 
ing one. ^ Solution to the problem is the development of a machine 
independe Unguage or meta-language. ' Aaronson (1971) of the Systems 
Developm^'^^ Corporation, the PLANIT developers, considers PLANIT to 
be a met^''^^Jig^j^ge, or least a meta- FORTRAN. Full development of 
an accept3-^^e rj^gta- authoring language would be historic for CAI. Such a 
breakthro^SH w^^d bridge CAl from its status of token implementation to 
full fledge^ application, having the "carrot" of portability as its attraction. 
Solution tc ^His problem mark the advent of widespread use of this 

mode of cC'^^putgr- based instruction. 
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(2) Interactive TerniinaK A second crucial computer subsystcin 
development engeneering the advent of computer-based instruction consisted 
of advances in interactive terminals, principally the alpha-numeric char- 
acter and graphic display types, Molnar (1972) describes the basic input- 
output terminal associated with CAT: the cathode- ray tube (CRT) which 
consists of an alpha-numeric typewriter keyboard and a CRT display for 
text and graphic materials provided according to the logic of an instruc- 
tional model and programmed strategies, A highly successful application 
of the CRT for CAI , but extremely limited regarding mass student usage, 
was the IBM 1510 display console consisting of a light pen, keyboard and 
CRT used with the IBM 1500 Instructional System, Besides the light pen, 
which is pointed at the CRT for making responses, the "joystick" and 
"mouse" are also available. These are moved manually by the student 
which in turn cause a spot on the CRT to move. Another variation of the 
interactive terminal is the RAND tablet which is a device pressure sensi- 
tive to the position of a pencil-like stylus used to write or draw on a tab- 
let which is automatically inputted to the computer and displayed. 

Walker (1970) indicated that the: "Teletype terminal is undoubtedly 
the most commonly used terminal device in the country. Constituting the 
basic terminal in the CAI systems sold by RCA and Hewlett-Packard and 
some systems sold by IBM, the teletype terminal is probably the least 
expensive device currently available for sale (p. 8)," However, although 
it is highly cost effective and has other favorable qualities, it likewise has 
several displeasing qualities particularly its high noise level and slowness, 
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Primarily for reason of cost, widespread use of the RCA ASR-33 teletype 
terminal has been made by CAI users rather than the CRT type display 
terminals. It appears that increased demand with mass production will 
resolve this problem. 

Obviously, the trend toward multi-media, popular in modern educa- 
tion, also has been incorporated in computer-based education with as many 
of the media devices interfaced with the computer as the state of the art 
will permit. Full automation of the learning center under computer con- 
trol has been an elusive goal for many educators, however it can be approx- 
imated quite closely, with many devices capable of being interfaced with the 
computer. Such devices, besides those described above, include: auxiliary 
image projectors, audio devices, touch panels and the plasma display 
panel. The latter device, developed at the University of Illinois (Bitzer, 
1970, 197 I) represents unique capabilities relative to the CRT. Unlike the 
CRT, it requires no image regeneration. In summary, while a truly cost- 
effective student terminal with wide appeal is within sight, the CRT, Plasma 
and teletype terminalj have been- ad vane ed to make true interactive CAI 
a reality. 

2. Specific 

a. U.S. Army Multi-Level Effort 

(1) Department of Defense Impetus. The introduction of computers 
in U.S. Army training was based on their high promise to provide more cost- 
sffective training without detriment to the quality of training. The Army has 
been involved in the development of a computer-based instruction (CBI) 
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capability since 1965 when the Secretary of Defense promulgated a letter 
to the Service Secretaries concerning innovations in Defense Training and 
education (DOD, 1965). The Office of the Chief of Research and Develop- 
ment (OCRD) and the Continental Army Command (CONARC) produced 
separate technical development plans (TDP). These were staffed at the 
DOD level. A single TDP was approved early 1967 for the development 
of a prototype CAI system and the conduct of a feasibility study using 
available IBM equipment. These two requirements were delegated to the 
Human Resources Research Organization (HumRRO)» Alexandria, Virginia, 
under the auspices of Project Impact, and the U. S. Army Signal Center 
and School (USASCS) then located at Fort Monmouth, New Jersey. A brief 
description of these two efforts is outlined below. 

(2) HumRRO Effort. HumRRO, at the time a Federal Contract 
Research Center for the Army and operating under the auspices of Project 
Impact, sponsored an advanced development effort designed to provide the 
Army with an effective and economical CAI system. The goal was to de- 
velop two generations of prototype individualized CAI systems. This effort 
was phased into four cycles to include four interrelated areas: hardware, 
software, instructional materials, and an instructional decision model. 

The original Project Impact was planned to be completed by the end 
of FY-71. This time frame was extended because of changes in the pro- 
ject scope and funding limitations. The architecture of HumR.RO's CAI 

■"•> 

system evolved to include the IBM 360 series computer, a Sanders-720 
student terminal, and a modified COURSEWRITER III language. Further, 
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HumRRO developed a COLIiOL CAI course of instruction and an instructional 
decision model (IDiM) and conducted other research tangential to effecting a 
full operational CAI system. It occurred, however, that upon completion 
of cycles 1 and a decision was made to transfer responsibility for the 
development of a fully automated CBI system to the Product Manager, 
Computerized Training System (CTS), Fort Monmouth, New Jersey in 
August, 1972. 

(3) CONARC M aster Plan. In accordance with a master plan 
(CONARC, 1968), the Army sponsored a number of delimited applications 
of CBI within the CONARC schools. However, the foremost application 
was represented by the CAI Project at the U.S. Army Signal Center and 
School (USASCS). Fort Monmouth, New Jersey • The Project was initiated 
in August 1966 with the submission of a CONARC TDP entitled "Computer 
Assisted Instruction in Electronic s Training'.' Subsequently, a CAI Feasi- 
bility Study was required (CONARC, 1967) to determine the appropriate- 
ness of CAI to Army training. The feasibility study v/as conducted under 
contract with the IBM Corporation between June - December, 1967 using 
the IBM 1500 Instructional System installed at the U.S. Naval Academy, 
Annapolis, Maryland. The favorable results of the feasibility study per- 
mitted continuation of the CAI Project and the letting of another service 
contract leading to the installation of an IBM 1500 CAI System at USASCS. 

(4) USASCS CAI Project. The USASCS approach to CAI con- 
sisted of individualized self-paced course material formatted predomi- 
nantly in the tutorial mode. The subject matter consisted of Army Common 
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Subjects Basic Electronicc taught at USASCS. Since the Project was a 
user-development effort, focus was placed on expedient development and 
operational use of the CAI lesson material in the Basic Electronics Program, 

During the period of June 1968 through December 1971 the equiva- 
lent of four weeks of instruction in basic electronics was developed and 
implemented for CAI presentation and approximately 1 300 students par- 
ticipated in this course of instruction. As the result of this user-develop- 
ment effort, the USASCS CAI Project developed a staff of military and 
civil service personnel who are fully capable of performing all tasks 
associated with directing and operating a CAI system. Contractor sup- 
port for system maintenance, or course, remains the most effective and 
economical alternative to minimize system down-time. 

Other significant by-products of the CAI four year project included 
the development of: an instructional model (Mizenko, 1971); a one-man 
authoring concept of lesson development; a macro system which elimin- 
ated the need for lengthy and repetitive computer coding (USASCS, 1970); 
three student performance analysis programs; an automatic student regis- 
tration procedure (Evans, 1971); a subroutine system to permit maximum 
lesson material to be disk resident while the instructional strategy was 
core resident thus extending the amount of lesson material capable of 
being on-line; a suggested modification of CORSEWRITER II Interpreter 
(USASCS, 1971); a CAI Instructional Programmer Training course; and, 
an instructional programming guide for CAI course material (Kimberlin, 
1971). Q9 



b. U.^ASCS CBI Evaluation Effort 
Due to the high potential cost expenditure incurred by computeri ..ed 
training systems and the relative infancy of this innovative technology, it 
was decided at the outset that the Army's CAI Project would undergo a 
rigorous formal evaluation of its feasibility, viability and effectiveness 
prior to any extensive implementation. Subsequent to the CAI Feasibility 
Study (IBM and CONARC. 1968) a series of phased and special evaluations 
was conducted in conjunction with the four year CAI user-developme nt 
effort with the IBM 1500 Instructional System (Longo. 1 969. 1972a. 1972b) 
and a three year applied research effort with the PLATO IV plasma display 
terminaMLongo. 1975). The purpose of these evaluations was to asses s 
the merits of this innovative training system in teaching Army Basic Elec- 
tronics Fundamentals and related topics via both CAI and CMI applications 
of computer-based instruction. The results of these studies provided the 
evidential basis for administrative decision-making regarding the overall 
acceptability and direction of CBI within the U. S. Army. A plethora of 
data was obtained concerning student attrition, achievement, attitudes and 
other performance criteria via both computerized and conventional Army 
classroom instructor training. However, except for CBI go - no-go infer- 
ences. much of this valuable data, based upon a multi-phase test- and eval- 
uation of two different CBI systems, has gone unreported; due to constraints 
of time and other administrative exigencies, a complete analysis and syn- 
thesis of all empirically obtained data for its operational implications has 
not been possible. Through such an analysis and synthesis, this project 
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will provi^^'^* en^pirically based gtidelines regarding the optimum applica- 
tion of Cpl as it pertains to a number of parameters relating to course 
and student cffoctiveness; and, empirically based recommendations re- 
garding further research required for the thorough enhancement and appli- 
cation of this n^ivv instructional technology in the S. Army. 
IV MAJOK ISSUES AND RESEARCH QUESTIONS 

In oi'der to attain the purpose of this project as stated in section II 
and in acc^i*dance with t\\ : nature of the problem as stated in section III- A, 
the following i^ajor issues, their associated research questions and assess- 
ment criteria ^ill be addressed. 

A. ISSUf^ A: Replication of Effectiveness: CBI vs CI 

Sem^'^ticexUy, eff^icti vencss is open to myriad definitions; and, exper- 
imentally, ^t is open to equally as many approaches regarding its assess- 
ment. Tb^^^efo^c, it is appropriate to further specify: the context within 
which eff c^tivet>es 8 of CBI is being viewed; the research questions being 
addressed ^nd the performance and affective criteria to be used, as appro- 
priate, for assessment purposes. 
1. C^ritext 

The P^i^^^ry overriding concern of any instructional innovation cen- 
ters upon reliable (replicated) effectiveness relative to already avail- 
able instri^^^ic^'^al methods, i. e. , conventional instruction (CI)« In other 
words, why cbai^ge vehicles? Further, initial concern for effectiveness 
is usually directed toward its feasibility and, subsequently, it is relegated 
to an analysis of its validity as it pertains to assessment of substantially 
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larger sarnpl in^'.s of course cont(!nt, students and time. The latter, be- 
Bides contributing to the development of guidelines for GDI use, will also 
yield an important by-product measure of the Mawthorne Effect, a funda- 
mental aspect of short versus long term data reliability. 
2. Research Questions 

Within the above stated context, therefore. Issue A can be translated 
into the following four research questions: 

a. What is the degree to which the U. S. Army has demonstrated 
the effectiveness of CBI in teaching Basic Electronics Fundamentals, from 
the point of view of its feasibility and viability? 

b. What is the degree to which the initial CBI feasibility results 
were replicated across three interim studies and a final summative eval- 
uation, each employing increased sampling of both students and instruc- 
ti Onal material ? 

c. What inferences relevant to optimizing CBI operationally are 
available from the CBI vs CI comparative analyses? 

d. What does the CBI vs CI comparative analyses suggest for 
further required research regarding CBI? 

3. Performance Criteria 

Regarding the information needed to address the four above research 
questions, the following performance criteria of effectiveness will be 
utilized in the assessment process: 

a* Achievement, Verbal tests, developed and validated in-house 
by subject matter and testing specialists of the Test and Development cadre 
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at the Common Subjects Fundamentals Branch of USASCS, are available 
as measures of student achievement. Two types of achievement are 
rneaBurcd for official records: written (for theory materials) and per- 
formance (for practical exerciscfi). Further description of these tests 
in given in section V-C-2(a). 

b. Attrition. Two measures of student attrition are officially 
made available: academic and administrative, 

c. Completion Time . This criterion has come to be the car- 
dinal factor in defending the economic merits of CBI. "Time i i3 money" 
ie axiomatic in large scale training centers. 

Considering the four major research questions on Issue A and the 
three basic performance criteria applicable to each question, this yields 
a set of twelve areas (potential sub- questions) to be addressed regardinr^: 
the comparative effectiveness of CBI vs CI; and, suggested guidelines and 
research on CBI. 

B. ISSUE B: Replication of Pi^ffecti venes s: CBI^l^ vs CBI^^) 

I. Context 

The second overriding concern of an instructional innovation pertains 
to its relative merits versus other similar systems. As emphasized in 
research protocol, there is no substitute for replication of findings. There- 
fore, after determining in what areas and to what degree CBI is more/less 
effective than CI, it becomes paramount to ascertain the commonalities/ 
differences in effectiveness between two CBI systems per se. As noted 
earlier, the two subject CBI training systems are: (a) the IBM 1500 Inotruc- 
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tional oyotem:(CrHpp; and (b) the PLATO IV Computer- baaed Educational 
System: (CBI^2))» Besides contributing to crystallizing guidelines for oper- 
ational use of CDI. analysis of two different CBI systems will provide 
needed evidence on the fundamental issue whether CBI systems of various 
types are similarly effective. Because of the infancy in this state of the 
art, it should be noted that such comparisons between CBI systems are 
practically nonexistent. In order to establish a basis for comparison, 
student disposition toward each CBI system was selected to provide the 
reference point for analysis vis-a-vis each system. 

2. Research Questions 

Within the above stated context, therefore, Issue B can be trans- 
lated to ask: 

a. How do two different computer training systems: the IBM 1500 
Instructional System and the PLATO IV Computer-based Educational Sys- 
tem compare with respect to varied affective criteria? 

b. What inferences relevant to optimizing CBI operationally are 
available from the CBI^^j vs CBI^^) comparative analysis? 

c. What does the CBI^jj vs CBI^^) comparative analysis suggest 
for further required research regarding CBI? 

3. Affective Criteria 

Regarding the information needed to address the above research 
questions, the following affective criteria of effectiveness vyill be utilized 
in the assessment process: 

^* Student Attitudes . Specially designed attitude questionnaires, 
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developed in-hou»c by the evaluator, are used to mcafiurc student atlitudeK* 
Student Opinions. Included in the attitude questionnaires were 
ample -^pportunitiefi for expressed opinions by students. 

c. Student Su^^ est io^ns. Included in the attitude questionnaires 
were ample opportunities for expressed suggestions by students. 
Further description of these questionnaires is given in section VI-C-2(b), 

The design and administration of these attitude questionnaires is 
discussed in the following section. Considering the three major research 
questions raised by Issue B and the three affective criteria of effectiveness 
applicable to it, this yields a set of three areas (potential sub- questions) 
to be addressed regarding affective student disposition toward the two 
separate computerized training systems CBI^jj vs CBI(2); and, suggested 
guidelines and research on CBL 

C.ISSUE C: Factors/Relationships Unique to CBI 
1. Context 

The third overriding concern of an instructional innovation pertains 
to the factors and relationships which are unique to it. Knowledge of 
relevant variables and their relationships is the necessary first step 
toward their facilitative use and manipulation directed toward their 
ultimate control. Due to the infancy of CBI, insight into those factors 
associated with it is as yet in the exploratory stage. Therefore, it is 
posited here as the third important area for investigation. Through 
a correlational analysis of all obtained measures, including study of 
the predictor - predictor and predictor - criterion relationships, a 
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significant uic\} tiuv.trd dorivinp d net of puidclincG for wc^c in GDI in anti- 
cipated. 

2, Research Quof;tionfi 

Within the above stated context, therefore, Io«uc C can be trani;latccl 
to aak the following: 

a. What are the relationships inherent in both the pre- and on- 
going GDI training variables, considering all available predictor and se* 
Iccted criterion measures, as related to the following perspectives: 

(1) Parametric description of GDI variables? 

(2) Understanding of CBI influencen / relationships ? 

(3) Prediction of student performance/success? 

b* What inferences relevant to optimizing CBI operationally are 
available from an analysis of the factors/relationships unique to CBI? 

c. What does the analysis of the factors / relationships unique to 
CBI suggest for further research regarding CBI? 
3. Validation Criteria 

Regarding the information needed tp address the above research 
questions, besides the predictor variables which will encompass the 
available pre- and on-going measures, the following validation criteria 
of effectiveness will be incorporated in the assessment process: 

a. Achievement, Represented bya set of continuous criteria, (Cf, 
section IV- A- 3(a)) 

b. Attrition, Represented by a set of dichotomous criteria, (Cf, 
section IV-A-'3(b)) 
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d. Attitude Score 8. (Cf. section VI-C« 2(b)) 

ConwichjrinR the fivo major rcaCtirch quOfitioni; raiflocl in conjunction 
with the four validation criteria of effecti vencfi and allowing; for a cer- 
tain degree of overlap among the possible combination of information 
cells (i.e., queationa x criteria), approximately twelve areas (potential 
sub- questions) u'ill Ix; addressed regarding tlie analysis of factors /rela- 
tionr.hips unique to CBI; and, suggested guidelines and research on CBI. 
V LIMITATIONS OF THE STUDY 

It should be noted that inferences drawn from the findings relating to 
the above issues and research questions must be interpreted basically in 
terms of two operational training systems rather than a rigidly controlled 
laboratory experiment. Of course, it is recognized that many researcherr 
have recently argued just as strongly in favor of realistic operational 
evaluation designs as others have advocated rigidly controlled research 
paradigms conducted in a "sterile!' laboratory. There are trade-offs 
for both approaches. Thus, the study procedures for this project may 
be generally characterized as quasi- expe rimental. 

Secondly, it should be emphasized that the study findings are gener* 
alizable primarily with respect to the tutorial mode of CAI which was 
employed in the instructional logic of the CAI material used. Some CAI 
drill and practice was included, however only to a small degree. There- 
fore, strictly speaking other modes of computer-based instruction (e.g., 
drill and practice, dialogue, problem solving, simulation etc.) should be 
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investigate^ ^cp^rately for their own respective merits. 

Thi^' ^V, keeping with the nature of student and subject matter 
tK 

sampling, e ^^^ults are generalizable only to similar student populations 
and eq^iv^^^nt bourses. Also, relatively speaking, the IBM 1500 study 
analysis ^^^^^Sents both a larger sampling of students and subject matter 
in comPar^^^n xvitb the PlATO IV study sampling. 
VI PllOC^^On^g AND METHODOLOGY 

A. gei^^J^al f^search methodology 

In vi ^ of lYic fact that this project has a number of major issues 
and reeea^^H qv^^gtions, it engages more than one method of research. 
Naturally, He ^^jected i-esearch methodology is issue /question depen- 
dent, Ha- or^ ^j^e resp^^tivc issues and questions involved, the follow- 
ing resea^' metbc^ds v^i\i be employed. 

1. i^^^os a/B 

SinC^ ^he^^j issues v^iH employ control and experimental groups, as 
obtainec^ i^' Operational setting, and include statistical tests of signifi- 
cance bet^ then^» general research methodology to be used in this 
project wjl^ considered as quasi- experimental. 

Simi^^^ly^ gince relationships will be ascertained between several 
sets of ^J^^^^^ncJe^t variables and severaldependent variables, the appro- 
priate me^^^cj employed will be correlational analysis to study the 
relationab^P^ ^rhong the variables. More specific details regarding the 
research ^^^^Ocjology to be employed are contained in sections B - D below. 
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B. INFORMATION SOURCES 

The data analysis for this project, as described in section D below, 
will be based on the data "bank" of information derived for an initial feas- 
ibility study and a series of six related CBI studies conducted in-house by 
this writer. As per each of the major issues this includes: 

1 • Issue A 

Analysis will be based on data files derived for an initial CBI feas- 
ibility study, four interim investigations, and a final summative evalua- 
tion of CBI. 

2. Issue B 

Analysis will be partially based on data files relating to the IBM 1500 
System analyr/i!: and partly as regards the PLATO lY Plasma Terminal 
evaluation, ail obtained in-house by this writer. 

3. Issue C 

Analysis will be based on Pearson Product Moment correlation 
matrices constructed from appropriate predictor- criterion data files 
as appropriate. 

Further descriptions of the statistical tests and analysis to be employed 
-will be given in section D below. 

C. SAMPLING, INSTRUMENTS AND VARIABLES 
1. Sampling 

(a) Students. The student sampling is representative of normal 
inputs of draftees and Regular Army students into the Army's Common 
Subjects Basic Electronics Course. 
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(b) MOS. The Military Occupatioiial Specialties (MOS) sampling 
will include (1) the Strategic Microwave System Repair (26VZ0}; and, (2) 
the Fixed vStation Technical Controller (32D20). These two MOS^s were 
selected because of their representativeness of qualifications required 

for basic electronics training, optimum size of class inputs, and frequency 
of reporting dates. 

(c) Subject Matter . The instructional material sampling for the 
most part encompasses the subject matter taught in the first four weeks of 
Army Common Subjects Basic Electronics. This ic equivalent to 102 hours 
of the conventional Plan of Instruction (POI). This material is subdivided 
into phase.'ji of instruction of two weeks per phase. Assessment will in- 
clude phase level comparisons. Related subject matter is employed in 
both the IBM 1500 System and the PLATO IV System analysis. 

2, Instruments 

(a) Achievement Tests. Both written and performance measures, 
officially obtained at the end of each phase of instruction are used. Where 
control and experimental (i. e. , CI vs CBI) comparisons arc to be made, 
such will be based on administration of the same achievement tests to both' 
groups. The following phase achievement tests are employed in the IBM 
1500 System analysis (Issue A): 
(1) Written : 

i) Phase I: (Wks. 1-2: Cf. Appendix A) 
ii) Phase II: (Wks. 3-4: Cf. Appendix B) 
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(2) . Performance ; 

i) Phase I: (Ibidem: Cf. Appendix C) 
ii) Phase II: (Ididem: Cf. Appendix D) 
Tocting of the PLATO IV System for this project consisted of attitude 
meaourement a« represented by a Z8 item questionnaire. (Cf. (b) next.) 

(b) Attitude Questionnairfc3> Attitude testing on the IBM 1500 Sys- 
tem consists of a short questionnaire used to obtain student attitudes, 
opinions and suggestions toward CBI. Basically, the questionnaire con- 
sists of 22 Likert items designed to yield both item and overall attitude 
scores. The questionnaire is constructed in two parts: (1) comparison 
of CBI with CI (11 items); and, (2) assessment of CBI per se (11 items).- 
An ordinal scale of 1-5 for each item yields total score variations rang- 
ing from: Pro-CBI - Neutral - Pro-CI for Part I; and, ''Favorable*' - 
Neutral - ''Unfavorable*' for Part II. (Cf. Appeidix E). 

Attitude testing on the PLATO IV System consists of a 28 item ques- 
tionnaire subdivided into two parts: (1) three different CBI modes of 
instruction (14 items); (2) the PLATO IV terminal per se (14 items). 
(Cf. Appendix F). 

3. Variables 

The relevant independent and dependent variables pertaining to this 
project are represented as follows: 

(a) CBI vs CI Achievement Assessment. Variables included here- 
in basically consist of two independent and four dependent measures. The 
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independent variables are: training method (varied 2 ways: CBI/CI), and 
aptitude level (varied 3 ways: hi/mid/lo); the dependent variables are: 
achievement (written/performance), time to complete instruction, attri- 
tion rate, and attitude toward CBI. 

(b) CBI(i^ vs CBI(2) Affective Assessment. Variables herein, as 
addressed by this project, basically consist of one independent variable: 
training method (varied 2 ways: CBI^ ] j /C BI^2) ^ dependent variable: 
student attitude (varied 2 ways: item/total score). 

(c) Achievement/ Affective Correlational Assessment . Variables 
included herein, basically consist of all predictor- criterion measures 
available under both the CBI and CI modes of instruction. In accordance 
v/ith standard correlational :natrix format, the predictor variables will 
represent the independent variables and the criteria will represent the 
dependent variables. 

D. STATISTICAL ANALYSIS, DATA PRESENTATION, INTERPRETATION 
Statistical analysis, data presentation and interpretation will be con- 
ducted as follows: 

« 

1. Issue A 

The basic design and findings of each CBI vs CI study will first be 
delineated. The analysis of these studies will include an array of descrip- 
tive and inferential statistics as the respective independent-dependent var- 
iables dictate. This will include simple descriptive measures (M, S.D. , %); 
the 'H"test for both cor related /uncorrelated samples; the F test: analysis 
of variance (ANOVA) two way fixed effects; and, test of correlated pro- 
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portions as the logic of the measures and situation dictates. The data will 
be presented via standard tabular format. As appropriate, the p levels of 
.05 and below, for both parametric and nonparametric tests of significance, 
will be indicated. Where the study variables permit, interpretation vis-a- 
vis major Issue A (and its associated research questions) will include an 
assessment of the effectiveness of CBI in teaching Basic Electronics Funda- 
mentals. Also, the degree of replication across the feasibility, interim, 
and final summative evaluation will be assessed by means of the '*t" test 
for independent means and the F-max test for variances. Lastly, a de- 
tailed interpretation of these findings on student achievement will be made 
for their contribution toward shaping guidelines for optimum utilization 
of CBI. 

2. Issue B 

The basic design and findings of the CBI^^j vs CBI^2) study (i, e. , IBM 
1500 System vs PLATO IV System) will first be delineated. Analysis will 
include, where feasible, the test of proportions. Farther, student 
opinions and suggestions will be subjected to content analysis. The data, 
both quantitative and qualitative, will be presented via both standard tab- 
iilar and figural formats as appropriate. Interpretation, vis-a-vis major 
Issue B (and its associated research questions) will include both inter and 
intra- asses sment of the two CBI systems with respect to: student attitudes, 
opinions, and suggestions. Lastly, specific interpretation of these affective 
findings on student attitudes will be made for their contribution toward shap- 
ing guidelines for optimum utilization of CBI. 

o 
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3. Issue C 

A correlational analysis will be conducted on all obtained measures 
having sufficient sampling. This will include a study of predictor- predictor 
as well as predictor-criterion relationships. Analysis will include inter- 
correlations; the Wherry-Doolittle matrix solution, a multiple linear re- 
gression technique yielding multiple R and the repertoire of simple and 
multiple regression statistics: i.e., B (beta) weights (standard score form); 
"b" weights (raw score form); etc. The data will be presented in standard 
tabular format indicating all basic correlation matrix data including means, 
standard deviations and correlation coefficients. Interpretation will in« 
elude: description of select CBI parameters; analysis of relationships 
peculiar to CBI; and, a determination of how predicted scores may be cm- 
ployed in CBI for instructional modeling and administrative student go- /no- 
go decision- making purposes. The scope of this analysis will extend to 
both the CBI achievement and attitudinal measures. As indicated for 
Issues A and B, this analysis also will be directed toward shaping guide- 
lines and recommendations for optimum utilization of CBI. 
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VII RESUl-TS AND ANALYSES 

The results and analyses of each of the three major issues and their 
subsidiary questions are presented in this section. A synthesis of the 
findings in the form of guidelines for action and recommendations for future 
research ^^c Pi-esented in the following chapter. 

A, ISstJ^ A: Replication of Effectiveness: CBI vs CI 

Thi5 issu^ primarily addressed the verification of initial CBI feasi- 
bility study results across several interim evaluations culminating in a 
final sutnm^tivo evaluation. Each of the follow-up studies involved a com- 
parison of CbI \vith conventional classroom instruction (CI) and increasing 
amounts of ^electronics course material. Intrinsic to this multi- study 
replication WaS a demonstration of the effectiveness of CBI to teach Army 
basic electronics. Inferences relevant to optimizing CBI operationally 
and reconni^end^tions for future research, the essential products of this 
project, a.^G discussed in the following chapter. The evaluation studies 
addressed the analysis of Issue A include: the feasibility study, a follow- 
up to the feasibility study, three interim evaluations and a final summative 
evaluation. It s}^ould be noted that the basic analysis of this particular 
issue is necessarily limited to the historical data sources and records 
available, thus i*endering their design methodology quasi- experimental . 
Also, as jyot^d in the '^Limitations of the Study" section (chapter V), it 
should be ^^^p^^sized that "...the findings relating to the above issues 
and research q^Ostions must be interpreted basically in terms of two 
operational ^^^aining systems rather than a rigidly controlled laboratory 
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experiment." The scenario for the below analyses will consist of an ex- 
position of the basic design and findings of each C BI vs CI evaluation, to 
include a brief resume of each evaluation study reported. 

1. CAI Feasibility Study (Wk. I: lll/lHrs.) 
a. Basic Approach/Results 

The initial CAl feasibility study (CONARC and IBM. 1968) was based 
on the first week of basic electronics material (1 1 1/4 hrs. ) taught by the 
Common Subjects Branch of the Department of Specialist Training, USASCS, 
Fort Monmouth, New Jersey. The basic design and results are contained 
in Tables 1-4. 

Table 1 

Experimental Design for Feasibility Study 



Aptitude Levels Instructional Methods 





CAI 


TV 


IC 


High 


6 


6 


6 


Medium 


6 


6 


6 




6 


6 


6 


N 


. 18 


18 


IS 



As indicated in Table ], the feasibility consisted of three training 
methods (CAI/TV/IC) at three aptitude levels (Hi/Med/Lo), (N. B. IC = 
Instructor Controlled). With 6 replications of experiment, this yielded 
an of 18 per method and a total N of 54. Both pretest and post test 
achievement data were obtained on all subgroups. This data was sub- 
jected to a fixed effects analysis of variance (ANOVA: based on a 3 x 3 

49 



36 

methods by aptitude data matrix). 

An ANOVA of the pretest and post test data (Tables 2, 3) indicated 
that all three treatment (methods) groups exhibited equivalent achievement 
both prior to and after their respective treatments. The nonsignificance 

Table 2 
Analysis of Pretest Data 



Source 


SS 


df 


MS 


F 


Instructional Method 


I 94. 04 


2 


97 


. 02 


1. 19 


Aptitude Level 


6088. 04 


2 


3044 


. 02 


37. 49* 


IM X AL 


159. 20 


4 


39 


. 80 


.49 


Residual 


3654. 00 


45 


81. 


. 20 





*£<. 001. 



of the methods main effect for the pretest data (Table 2) insured an ade- 
quate sampling basis existed for further testing of the methods effect in 
the post test data (Table 3). The nonsignificance of the methods main effect 
for the post test data demonstrated that none of the mean differences after 
the three training methods were administered ended up statistically sig- 
nificant. Thi s result held also across all three aptitude levels, as indicated 
by a nonsignificant interaction effect. As expected, the aptitude level 
differences in both situations were significant. 

The standard assumptions for ANOVA were met or approximated 
in the above ANOVA as folio w s: 

(1) Random Sampling . As indicated in Table 1 the n's are the 
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same (6) for cuch method x aptitude cell. The selection and allocation of 
students within each of the cells were random thus insuring independent 
observations within sets. 

Table 3 
Analysis of Post Test Data 



Source 


SS 


df 


MS 


F 


Instructional Method 


180, 78 


2 


90. 39 


1. 27 


Aptitude Level 


10075. 12 


2 


5037. 56 


70. 86* 


IM X AL 


256. 44 


4 


64. 1 1 


. 90 


Residual 


3199. 05 


45 


71. 09 





_£ <. 001. 



(Z) Homogeneity of Varicance . As indicated in Appendices G-H, 
the aptitude level variances showed marked differences in both the pre- 
test and particularly the post test scores. Using the F max-variance 
test for independent variances, the following was obtained: 

(a) Pretest Varia nces: 

2 , 2 
where: S. D .^^^ / S^. = 2.24 

and: _df = 18, 18 

then: F =2.24 (significant: p <. 05) 

(b) Post Test Variances : 

2 2 
where: S. D. / S. D. = 3. 77 

(1) (2) 

and: d£ = 18. 18 

then: F =3.77 (significant: p<C.01). 
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Given that the V test for the pretest variances was significant at the . 05 
level, and the post test variances significant at tho. , 01 level, the use of 
a more stringent F level for the aptitude main effect was indicated. {Guil- 
ford. 1965). In such cases, an accepted practice is either to reduce the 
number of degrees of freedom by 1 /Z or, more directly, cut the alpha 
level projected for use by 1/2. As is known, this effectively compen- 
sates for any artificial! inflation of the mean square for the partition in 
question (i. e. . aptitude level) and possible overstatement of significance 
of differences in that area. Consequently, based on an alpha level of . 005 
(i.e., 1/2 of. 01). the resultant s for both the pretest and post test 
aptitude main effect still attained significance: i.e. , p in both cases was 
<C. 001. Therefore, the lack of aptitude level homogeneity of variance did 
not impact adversely on the results of either ANOVA. The use of 1 /2 the 
alpha level (McNemar, 1949) effected a more stringent test of significance 
in this case than would have been achieved by reducing the df by 1/2 (Sne- 
decor, 1946). 

(3) Normality of Distribution . The initial feasibility study 
(Conarc and IBM. 1968) assumed the position advocated by the classic 
Norton studies (cited in Guilford. 1965) on the effects of nonnormality 
of distribution and heterogeneity of variance on ANOVA. This posits that 
F is rather insensitive to variations in shape of distribution but more 
sensitive to heterogeneity of variances and only when variances are 
markedly different. 

Besides data on student achievement, a measure of time to complete 
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week I CAI material was obtained also. In comparison with the fixed 
instruction time of I 1. Z5 hours for the TV and IC methods, the CAI group 
demonstrated a mean time of 10. 03, a 10. 8 % reduction in training time. 

Table 4 

Summary of CAI/CI Module Completion Time 





CAI 


CI 


Aptitude Level 


M (Hrs) 


M (Hrs) 


High 


5. 72 


11. 25 


Medium 


9. 37 


11.25 


Low 


1 5. 00 


11. 25 


Total Group 


10. 03 


11.25 



Note. CAI strategy was self-paced, 
CI strategy was lock-step. 



Because of the complete lack of variability in the CI completion time, the 
differences between the means were not amenable to significance testing. 
A summary of the CAI/CI student completion time is contained in Table 4, 
b. Resume of Results 
The CAI feasibility study achievement results indicated that, on the 
average, CAI v/as as effective in teaching basic electronics as either the 
TV or IC methods. This held true across the entire aptitude range. In 
contrast, a modest time savings was obtained'lay^the CAI group through 
self-paced instruction. The basic feasibility study conclusion therefore 
was that the CAI group achieved equally as well but in less time than its 
counterpart CI group. This finding forms the basis for the replication 
study analyses to follow. CO 
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2. Feasibility Study Follow-up (Wk 1: 11 1/4 Hrs.) 

a. Basic Approach/Results 
Subsequent to the feasibility study, a follow-up study (Longo, 1969) 
was conducted on a slightly revised version of week I ( 1 1 1 / 4 Hrs. ) basic 
electronics course material. Based on the feedback obtained during the 
conduct of tlie feasibility study, a few lessons were consolidated for a 
clearer presentation. By design, this follow-up study endeavored to im- 

Table 5 

CAI vs CIiMatching Characteristics 
(Wk. I: 11 1/4 Hrs. ) 



Matching/Aptitude ;> CAI CI 1? " 

Measures 1 SD SD SD 



Prod. Ph.I^ 1.00 103.30 1 1.40 103.30 1 1.40 ---^ --.-^ 

Age .50 20.16 2.49 20.10 1.76 .52 4.34* 

Education .49 12.78 1.45 12.90 1.45 1.38 

Electronics .52 121.40 12.05 120.62 12.26 1.07 .33 



Note . Matching/Electronics measures = standard score form. (N=278) 
*^Pear6on Product- Moment correlation: between the 2 study groups. 
^£ test(for correlated means / s^^* s): for 277 df, Jt=l . 97/2. 59 at . 05/. 01 . 

for 139df. Jt^=l. 98/2. 61 at . 05/. 01. 
^Matching variable: matching by pairs design. 
^No absolute difference obtained. 
*p<. 01. 

prove on a basic feasibility study weakness: i.e., small sampling. While 
the feasibility study was conducted under severe constraints of time and 
CAI terminal availability, the follow-up study was able to accrue a more 
respectable sample size. Thus, in contrast with the feasibility n*s of 18 
per condition, the follow-up N's were 278 per study group. The basic 
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results are contdined in Tables 5-7. As indicated in Table 5, the two 
study groups were equivalent on the matching variable (predicted plume 1) 
and were also found to be equated on three other available measure?^: age, 
educafion, and electronics aptitude. This equivalence pertained to both 
the means and variabilities of all four measures (except for age varia- 
bility). Statictically, based on the t test ucing 1 /Z the df, as r econiinend cd 

Table 6 

CAI vs CI: Phase I Achievement/Time 







(Wk. 1: 


1 ] 1/4 Hr 


s. ) 








Matching / Perfo rm anc e 
Measures S.'^ 


CAI 
_M SD 


CI 

M 


SD 


M 


- SD 


Fred. Ph. I 


1. 00 


1 03. 30 


1 1 . 40 


1 03. 30 


11.40 






Written 


. 61 


61. 92 


1 3. 25 


62. 44 


12.84 


75 


. 66 


Tirne I 


e 


8. 99 


3. 02 


11. 25 


e 

--- (20. 


1 % 


P eduction) 



Note, Matching/Achievement measures = standard/raw scores re<^pec'ly. 

Time = in hours. (Nr:278) 
^Pearson Product- Moment correlation: between the 2 study groups, 
^t test (for correlated M.'s/fJ)'s): for 277 df , 1=1. 97/2, 59 at . 05/. 01, 
^^l^iatching variable: matching by pairs design. 

ritten I: represents only v/eek 1 of phase I. 
^CI group: fixed time = no variation (thus no r or SD possible.) 

where variances are significantly different (Edwards, 1954; Snedecor, 1946), 

the age mean difference still was nonsignificant. Thus, given the two study 

groups were eauivalent, experimental comparisons between them v/ere 

possible • 

Analysis of the tv^o criterion measures, written test I and time-to- 
complete I is contained in Table 6. As indicatf!d, the two groups demon- 
sti-ated equivalent achievement on the written test. However, a substantial* 
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difference exif.tcd between the grnuj^s on the tirne-to-cornplete I measure. 
The difference » in favor of the CAI group, was Z, Z6 hours ( 1 1 , Z5 - 8, 99), 
This effected a ?-0, 1 % reduction (savings) in training time. It should be 
noted that due to tlic lock step nature of the CI instructional packap,e no 
variability (SD) in tirnc-to- complete was obtained. This precluded proper 
computation of any correlation between the two study groups and, consc- 
quc. itly, any coiTijmtation of a parametric test of significance on this varial le, 

Table 7 

Fea5;ibility vs Follow- up CAI: Achicvcme nt/Tiimc 
(Wk. 1:111/4 Hrs, ) 



Performance > • aslbility CAI Follow-up CAI J_ J] 

Measures SD M SD M SD 



(N-278) 

Written I 60.20 1L40 6K92 13,Z5 .49 K 18 

Time I ]r.'J3 3,83 8-99 3, OZ 1.13 K 61 



Note. Written Test " luw score form only. 

ajt_ test (for indepfrndent rnear.s): for Z94^, ^= K 97 / Z, 59 at • 0 5 /, 0 1 • 
^Ftest (for ind ependei.t SD's ) : for Z7 7, 1 7 df, F= K 95/Z, 61 at , 05 A 0 1 . 
^^ritten I: represents 07ily week I of phase I; 85 items - raw score form^ 

The basic comparative results between the feasibility study and its 
follow-up analysis are contained in Table 7. As indicated by the t test 
for independent means and the F test for independent variances, no sig- 
nificant difference in means and variances was obtained between the two 
CAI studies (feasibility /foil ow- up) on the two performance measures em- 
ployed. Thus, on the basis of their mean written scores, the two study 
groups differed by only 1.72 (i.e.. 6l.9Z-60oZ0); and, regarding their 
mean time scores, a difference of only 1. 04 (i/e. , 10. 03 - 8. 99) was 
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obtained. Similarly, negligible diffcrenceo were obtained on the variajiccs 
of these two variableo between the two study saniplcj^o The lack of r.i(^^,ni- 
ficant differences in both nieans and standard deviations represents rcj;li- 
cation of the fecisibility study results, 
b. Resume of Results 

As with the feasibility study, the follow-up acliievennent and time 
results supported the effectiveness of CAI, Basically, it was observed 
that, relative to CI performance, the follow-up results supported the 
feasibility findings that CAl effects equal or better acliievcmcnt than 
CI, and in substantially less time, 

3. CAI Interim Study (V/ks. 1-2: 42 Hrs. ) 

Subsequent to the follow-up fitudy, two interim studies and a final 
summative evaluation (L.ongo, 1971a, 1971b, 1 972) wer e cond ucted on 
the feasibility and viability of applying CAI in teaching Army basic elec- 
tronics instructional material and representative performance tasks. By 
design, each succeeding study employed increased amounts of basic elec- 
tronics instructional material and larger sampling of enlii:)ted Army per- 
sonnel relative to the initial feasibility study. Respectively, these three 
studies included the following content / student sampling: (a) weeks ]-2: 42 
hours/N=155; (b) weeks U3: 72 hours/N=121; and, (c) weeks 1-4: 102 hours/ 
N=109. Except for weeks 1-3 analysis (cf. section 4 below) student sampling 
in all studies was drawn at random from the same two Army MOS's used in 
the CAI follow-up study: (a) 26V20: Strategic Microwave System Repair; 
and, (b) 32D20: Fixed Station Technical Controller System Repair. Similar 
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to all the cvUluatioTin, the basic design for the inlctrim studies copr>if;tod 
of two matched grouj^o. one used as a control f;roup (CI) and the other lkh 
the experimental ^',roup (CAI). It should be noted that in all studies in the 
series, except the final sunmiative evaluation, the CI time-to- complete 
criterion represented only fixed POl (plan of instruction) time and ex- 
cluded netback time. However, the summative evaluation included all 
setback time, thus permitting time variability in both study groups. The 
interim study results reported next pertain to weeks 1-Z (12 liours). 

Table 8 

CAI vs CI: Phase I Achiovenient/Time 
(\Vks. ] - 2: 42 IJrs. ) 

' " ■ - — — ■ - — ' .... ... — ■ ■ . ■ ■ 

Matchinr; /Perfortnancc CAI CI t 
Measu r es M SD M SD M " S l> 

Pred. Ph. l'^ 1. 00 101. 55 10. 55 101.55 10.55 

Written I ..18 101.05 19.41 99.65 19.15 .89 .19 

Performance I .36 107.00 16.91 103. 29 18.1 3 2.34* .92 

d d 
Time I --- 29. 92 12.30 42.00 - - - (29 % R educ tion) 

Note. Matching/achievement measures = standard score form. (N=155) 
Time = in hours . 

^Pearson Product- Moment correlation: between the 2 study groups. 
W test (for correlated M's/SD's): for 1 54 d£, t_ = 1 . 98 /2, 6 1 at . 05/. 01. 
^Matching %'ariable: matching by pairs design. 

*^CI group: fixed time = no variation (thus no r or SD possible). 
%<.05. ~ ~ 

a. Basic Approach/Results 
The results of this interim study are contained in Table 8. In con- 
sonance with the earlier studies discussed, the matching results of the 
two study groups was first established. Table 8 confirms that equated 
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groU]is were oljtainecl and provided a valid basis for further study. Anal- 
yeis of the three criterion measures, written test I, performance test I, 
and tiinc-to-compl et^^ I, is cilso illustrated in Table 8. The written te?t 
mean scores for t'ne two groups were found to be equated^ However, the 
mean performance scores were found to be significantly different, witli 
greater achievement demonstrated in favor of the CAI group, by 3.7! 
points (i.e., 1 07, 00 - 10 3,29), As in prior analysis presented, a sub- 
stantial difference was obtained between the study groups on the time-to- 
completc measure. Thus, a niean score difference of 12. 08 hours (in 
favor of the CAI group: i,'e, , -12. 00 - 29. 92) resulted, whicli effected a 
29 % reduction (savings) in training tmie. Again, due to the lock step 
nature of CI, the lack of variation in time-to-complcte training prevcntc-d 
computation of any correlation and Jt_ testing of significance in relation to 
this criterion, 

b. Resume of Results 
The results of this study regarding the r^vlative peiformance of tv^o 
different instructional methods, CAI and CI, on three separate criteria* 
of electronics training, achievement (both written /perform ance tests) 
and time- to- complete instruction, mirrored the basic results of the fcasi 
bility study and its follow-up investigation. Thus, relative to CI perform 
ance, the findings of this interim study supported the basic feasibility 
findings that CAI effects equal or better achievement than CI, and in sub- 
stantially less time. 
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4, CAI Interim Study (Wks- 1-3: 72 Hrs, ) 

a* Basic Approach/Results 
The results of tliis interim study are contained in Table 9. As 
illut:trated, the matching jjroccss yielded two equivalent groups which 

Table 9 

CAI vfi CI: Phase II Achievement/Time 
(Wks, 1-3: 72 Hrs, ) 

Matching / Per fo rmaiice CAI CI 

Measures £^ gP H §g ^ §g 

Fred, Ph. I^ 1.00 ]03,89 9-30 103,89 9.30 

Written II .43 113,18 16,35 110,67 21,27 1.70 3,21^^' 

d d 
Time II 5C. 56 16.75 72.00 (30 %Reductipn) 

Note, Matching/achievement measures = standard score form, (N=l?.l) 

Time = in hours , (For this MOS ph. II = wk 3 only /no perform, t^.^st), 
^Pearson Product-Moment correlation: between the 2 study groups, 
\ tost (for correlated \£s/Sh's): for 120^, 1= ^- 98/2, 62 ,\t . 05/. 01, 

for 60 df, £ = 00/2. 66:.t . 05/, 01 , 
^Matchinj variable: matching by p^^irs design. 

*^CI group: fixed time - no variation (thus no r or SD possible, )• 
*£<,01, " 

provided tl\e basis for further comparative analysis. It shonid be noted 
that, for the three Army MOS's employed (3133. 3ZF2, and 36H2) in this 
interim study, phase II is represented entirely by week three content. The 
achievement criterion test for this week of training consisted only of a 
written test and did not entail any performance testing. Analysis of the 
two available criterion measures for this study, written test II and time- 
to-complete II, are reflected in Tabl3 9« The v/ritten test mean scores 
I'or the two seedy groups were equivalent: i, e. , the difference between the 

60 



ERIC 



47 

meann was 1 f » which ai^^pvoached but did not attain significance. At; in 
the previous investigations, a substantial difference was obtained between 
the study proupb on the tim e- to- com j)l etc criterion. Thus, a niean tiine 
score difference of Z\. AA hours (in favor of the CAl group: i. , 72, 00 - 
SO. 56) rof-:ultcd, which yielded a 30 % reduction (savings) in time, 
b. Resume of Results 

The results pertaining to achievement (written test only) and timc- 
to-complete training again reflected the findings of the earlier studies in 
this series. Thus, the CAI group exhibited at least equal achievement 
and completed training in substantially less time in comparison v^itli 
their counterparts in the CI group, 

5. Final Sun.mative Evaluation (V/ks, 1-4: 102 Hrs,) 
a. Baric Approach/Results 

The culmination of this series of CAI feasibility /follow-up studies 
was a final summative evaluation. This study represented the cumulative 
in-house efforts in the development of CAI instructional materials: i.e. . 
102 hours of computer-based instruction consisting of both CAI (primarily) 
and CMI. For the purposes of analysis, the same basic study- control 
group design using matched groups (matching by pairs) was employed. 
The results of this evaluation are contained in Table 10. Again, two 
representative Army technical MOS*s were used as the sampling basis: 
(a) 26V20: Strategic Microwave System Repair; and, (b) 32D20: Fixed Sta- 
tion Technical Controller System Repair, As indicated in Table 10, the 
matching process effected two equivalent groups, thus providing the basis 
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for furth(jr tr<;alrn(»nt and anc'ilyfji k. The achicvcniont critcrioii tests for 
thie phase of training conf;istcci of both a written and perforniancc te.r.t, 
Analycic of these two available criteria, written tef?t II and t inie- to- co.r - 
plete II, is contained in Table 10. Both the written and ])erforniancc tc:U 
mean scores for the two otudy groups were found to be equivalent on tl)e 
basis of the t test of si[]nificance. The differences between the nican.s 
were trivial: • 49 and ,77, respectively, and therefore nonsignificant. 

Table 10 

CAI vc CI: Phase II Achievement/Time 
(Wks, 1-4: 102 Hrs, ) 



Matching / Pe r fo rnia nc c 

r ^ 

Measures ^ 



CAI CI ~ 

M SD M SD M SD 



Prcd. Ph, .99 105.68 9.14 105,57 8.99 K 94 

Written II .40 78. 7Z 9.80 78.23 10,01 .47 , 

Performance II ,29 85.02 8,91 84.25 10,68 .68 1.9/ 



d d 



Time II .10 75.82 24,08 118.62 31.45 11.87 2. 8;^. 

Note, Matching /achievement measures - standard/raw scores respecMy, 

Time = in hours. {N=109) 
'^Pearson Product- Moment correlation: between the 2 study groups. 
\ test {for correlated M's/SD's): for 1 08 d£, =^ 1 . 98 / 2, 63 at . 05/. 01. 

for 54 df , t ^ 2. 01 / 2, 67 at . 05/. 01 . 
^Matching variable; matching by pairs design. 
^^Time reduction: 36. 1 To (savings), 
*p<.01, 
*"p <. 001, 

Similar to the prior analyr.cs in this series, a substantial difference was 
obtained between the study groups on the time- to- compl ete criterion. A 
mean score difference of 12. 8 hours (in favor of the CAI group: i. e, , 
118. 62 - 75.82) was derived which yielded a 36. 1 % reduction (savings) 
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in tiiric. A.*;' tu')tof] above, tlic desif.n of thin particular suniinalivc study 
permitted the collecting of .setback tirne for the CI utudy sarn])le. Tliis 
Rcneratecl a variance meaHurc on titn e- to- complete training; for Ihir^ con- 
trol (.'.roup which was lackin|; in the j^rior analyses in tliis ^:erics. Thus, 
with a titne variance available for both stuc^y groups, the computation of 
a time criterion correlation, and thereby a mean difference test of sii^,- 
nificancc between the tv/o groups, waj made possible (cf. Table 10). The 
latter analysis ))rovided sup])ort to tlie earlier findings of a substantial 
reduction in time-to- complete training in favor of the CAI group, Tlie 
difference of 4Z. 80 liours between the mean time scores, reflectin[^ a 
36. I % time reduction for the CAI group relative to the CI group, was 
found to be stati^itically significant with p <;.001, Tlie fact that tlie 
variance for time itself showed a significant difference between the two 
groups did not alter ilie basic finding between the tv/o group means on 
time-to- complete training. Given the procedure of reducing the df by 
1/2 in such cases , and thereby establishing a more stringent Jt^ level of 
significance (Edwards, 1954; Snedecor, 19^6), the test for the means 
still retained its high significance (cf, footnote^ to Table 10). 
b. Resume of Results 
The findings of the summative study were in exact alignment with 
all prior results on achievement (both written and performance criteria) 
and time-to-complete training. Thus, the CAI group demonstrated equal 
achievement and completed training in significantly less time in compar- 
ison with matched CI study groups. 
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B, ISSUJ-: I^: Replication of EffcclivonoGfi: ClU^^j vs ClU^^j 

The issue primarily adciressod in this iJCcMion if-; tlie roi^liccition of 
the effectiveness of CRI *^r, excniplifiod by two clifitinct CIM r>y r-tcm r. : llie 
IBM 1500 Instruction:il Syr;lem (ClU^^^jand the PI.ATO IV Kducation Syi;- 
teni (CDL^J, Three areas are focused on in tins issue: a determination 
of tlie conimonality and differences between the two CDI Bystems; optiirii- 
zation of the operational use of CI31; and» potential CRI aspects for fur- 
ther research and evaluation. The results and analysis of the first area 
will be considered in th.is section, while inferences and recommendations 
pertaining to the latter two areas v/ill be addressed in the following chap- 
ter. The criteria basis for analysis of tlus particular issue is represented 
by tv/o attitude /opinion questionnaires administered s epr^ vr.f.el y to each CDI 
study group. Due to the classroom operational conditions under which the 
data collection was conducted, this analysis, similar to tlie prior issue, 
is classified as quasi-experimental. The evaluation scenario will include 
both quantitative (significance testing) and qualitative (content analysis) 
assessment strategies, examining the attitude results both by item as well 
as by total scores. Also, as with the prior issue, a summary of the atti- 
tude/opinion results for the two CBI study groups will be given. This will 
include for each CBI study group, a description of the approach, sampling, 
and test instruments employed, and a resume of the obtained findingSo Spe^- 
cific to this analysis will be a comparison of attitudes toward the two CBI 
systems cited above. 

1, CBI^jj vs CBI^2)- Attitude Item Scale Responses 
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a. r»af;ic Ai)pr(>a(;li /l^ CGul ts 
Besides eeveriil mea.sures of achiovdrrient, tlie IHM 1500 sivuly {;)-ou]') 
(ClM^lj) inchuhul a ine«usuro of attitude toward ^'.oneral iind f;]>ecific as]M:ct» 
of CAI (com])Uter af^sii^lud infUruction). Tlio infitr uriicnt deiji^ncd to mcras- 
urc thoBo attituder. consisted of two parts: conipariuon of CAT. vc:i\sus CI 
(11 items), and aii^ujnsrnent of the CAI environment per ce (11 itemn). It 
alBO included three general questions designed to elicit student opinions 
and cupgcr^tioiis (cf. Appendix E). By de5;ign tliifj quej^tionnai re was ad- 
niinifitered twice: after -1 week?^ of CAI instruction, and. subsequently, after 
two weeks of CI instruction to the satne students. The fourtli week mcarure 
was given special focus in this project. The latter measure, of course, 
represented a more thoroi^fh index of CAI attitude f^ince it included tv^o 
weeks of CI material experi ence, giving students the opportunity to com- 
pare the relative merits of tVie two instructional systems. Similarly, the 
PLATO IV study group (CBT^^)) included a measure of general /specific 
attitudes toward both CBI techniques: i.e. , CAI/CMI. Tlie instrunient de- 
signed to measure these attitudes consisted of two parts also: instructional 
uses of PLATO IV and PLATO terminal and work area effectiveness; and, 
was administered to tv/o study groups: individual-learning (I-L) and peer- 
learning (P-L). Likewise, this questionnaire included an opportunity for 
students to express their opinions and suggestions. Lastly, it should be 
noted that the attitude data obtained in this section is represented by cell 
frequency talleys associated with student responses to each attitude scale 
item. As categorical measures of ordinal scales therefore the appropriate 
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test of ntatistiCiil r.i|',nif)^*'Wice i*; the noni>ara»netric test: Chi Square 

£:]}} (1) d^Ul^JiiiL^i-i^ '"^'^^ rcfHiltR of the atliliuh; 

BCtilc responses for the ^'''-'o CBi sUidy Rvc>upn art; containod in Tables ll-M. 
For the sake of clarity, ^^^ch of the tablcr, incladen itom results for tlic two 
parallel analysis conduc^^*U on the Iwo respective CBI syi^tcmr,: i. e. , week 
4 versus week 6 (for CBl ^j^); «lnd» versus P-L (for CBI ^^^). Thus, the 

results are conveniently ^'ir:playc<^^ in only foar tables aucl facilit.Jte conipari- 
cons between the parallcjl Conditions. 

The sipjii ficance ofthci iteiri ^'csponscs on the CBI ^^^i i. e, . the IloM 
1500 System, questionnai^^^i (p^rt 1) ^^^^ contained in Table 11. The X'^' tejit 
of the hypotlicsis of equa^^ ProbctbiHty across response cells (null hypothesis) 
was used on each item, '^^hus, given the U itcni questionnaire administered 
at the end of the fourth sixth wefik of training, this yielded 22 separate 

tests. The results if^^^icatGd that: 18 of those tests were highly signifi- 
cant (p<. 001); one te.st signifi^'^^*'^ at j^<,Ol; and, 3 were nonsignifi 
Accordingly, all item re^^Us, e^^cept the 3 nonsinni ficant items, were 
judged to be pro-CBI. indirection of Table H (for full item description see 
Appendix E) indicates the ^1 attitude areas responrlod to by the students. 
Noteworthy, by exceptio^^* is that the nonsignificant tests appeared at week 
6 only. The respective ^^<^as co'^^rcd by these 3 items Nvere: "learning of 
electronics", "retention ^^se". and "given assistance" (i.e., students 
were impartial toward C^WCI regarcJing learning new material, retention 
of new material and bein^ ^ssist^d d^-iring difficulties). 

The results of part U aro contained in Table 12. In this instance, all 
^Where df - 1 (in Tables ^1-16)^ YateS cor rection for continuity applied. 
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Tabic; ) 1 

Attitude tow.ird tin- DWi K.OO riyMi-m; by Itciii 
(l\irt I: Wks. .1/6) 



Attitude IU:fii)OnHc: J'"rcqueiicics "P'i'^' C<-"1 

Items Gp. ^'^A" b c ci ^1." flf x2 Cj^i 



1, 


1^ c a r n i lu; 1" 1 e c t r o n i c s 


V/k 


•1 : 


1 1 


17 


26 


36 


4 8 


4 






\V Vv 


6: 


1 7 


2 1 


22 




30 


.1 


2. 


n ctontion 


Wk 


4: 


1 5 


20 


2 1 


4 3 


3 6 


4 










1 R 

1 O 


? 1 


'? Q 

L. J 


s> u 




A 
'I 


3. 


Tailored to Need;; 


Wk 


4: 


1 4 


16 


1 2 


37 


59 


4 












1 0 






2 Q 
J 7 




4. 


Given Assistance 


W 1: 


•1: 


1 5 


12 


27 


30 


54 


4 






W K 


t) : 






2 9 


3 


24 


4 


5. 


Sequence oi Material 


Wk 


4: 


6 


4 


28 


4 5 


55 


4 








: 


7 


b 


39 


3 9 


34 


4 


6. 


Attention Facilitatetl 


W h 


4: 


9 


12 


1 2 


32 


73 


4 








/ . 

u . 


1 n 
1 u 


o 










7. 


Ijea.rnin(' Atnior;i:)!i(;:re 


\V k 


4: 






1 4 


28 


88 


3 






Wk 


6: 


6 


8 


1 5 


3 5 


61 


4 


8. 


Use of Training; Time 


W k 


4: 


7 


9 


14 


31 


77 


4 






Wl; 


6: 


1 3 


5 


24 


3 3 


50 


4 


9. 


Interest is Sti -^^ ':]atcd 


k 


4: 


"> 
/ 


16 


29 


30 


56 


4 






Wk 


6:- 


14 


1 3 


34 


36 


28 


4 


10. 


Fatigue in Tr-iinii-:^ 


\Vk 


4> 


7 


21 


24 


4 2 


4 4 


4 






Wk 


6> 


7 


12 


35 


36 


35 


4 


1 1. 


Overall Opinion 


Wk 


4: 


5 


13 


9 


48 


63 


4 






Wk 


6: 


10 


15 


21 


44 


35 


4 



31.4c ^^ro 
8. 5s 



>1< In 

14.9-1 ' ro 
4.40 

4 1.8,^?"' ^\-o 

14.40* ^S-o 

39. Sd^"" ^\-n 

2. 4a 



74. 2?.- ^\-c. 



46. yt' 



J- 



44. 9(^^'' ^\-o 

149. 8(f'' ^ro 
85.8.^'' ^^o 



49. 35'^'^ ^\-o 



49. O?'"" ^vo 
19.04^^'' ^>:o 

34.21**^^^0 
32. 56'^'' I%o 

97.86;;"' 

32. OS'*' f'^o 



Note. Part I of attitude questionnaire = comparison of CAI/CI (]! ^^cUis). 
^Includes Zf's from cell "a". 

^Cell frequencies reversed (a - e) for constancy. 
*p<^.01. 



**p< .001, 
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Tabic lii 

Attitude toward the IBM 1500 Sy.'itcin: by Item 
(Part II; Wks. -1/6) 



Attitude; KeuponRC l-"rcqucncicr. Pro/Con 





Itcrm? 


Gp. 


ii 


b 


c 


d 


Con 
c; 


rif 




cm 


1. 


Sequence of CAl 


W k 
Wk 


4: 
6: 


63 


65 
59 


(10) 

8 


(6) 




2 
3 


104. 2 1.,^ 
101.09'" 


Pro 

Y'vo 


2, 


Heading Skill IjOvoI 


\V k 
Wk 


4: 
6: 


5 


19 
15 


78 
59 


32 
39 


9 

7 


3 
4 


10 5. 64, 
87. 04 


Kent. 
Kent, 


3. 


Style of CAI 


Wk 
W k 


4: 
6: 


1 2 
1 1 


59 
56 


37 
28 


19 

24 


1 1 
6 


4 

4 


59. 56^ 
61. 12 


Pro 
Pro 


4. 


Carrel Comfort 


Wk 
Wk 


4: 
6: 


R3 
78 


37 
33 


1 2 
8 


(6) 
(6) 




3 
3 


1 37. 36, 
140. 92 


Pro 
Pro 


5. 


■Fatigue Experienced 


Wk 
Wk 


4: 
6: 


13 
1 0 


65 
64 


1 1 
16 


42 
29 


7 
6 


4 
4 


90. 00* 
88, 16 


Mixed 
Pro 


6. 


IIclpfulncGs of Slides 


Wk 
Wk 


4: 
6: 


77 
64 


48 
37 


6 
1 5 


CM 
(9) 




3 
3 


1 33, 08*1*' 
80, 84'^ 


Pro 
Pro 


7 
* • 


Number of CAI FramesWk 

Wk 


4: 
6: 


27 
17 


85 
79 


1 9 
18 


7 
7 


4 


3 
4 


134. 7 2* 

15K76* 


Pro 
Pro 


8. 


Frame load 


Wk 
Wk 


4: 
6: 


37 
25 


80 
80 


1 2 
1 3 


(9) 
(7) 




3 
3 


121, 49* 
139. 72* 


Pro 
Pro 


9. 


Background Noise 


Wk 
Wk 


4: 

6: , 


61 
53 


62 
52 


10 
1 3 


(5) 
(7) 




3 
3 


1 10. 64* 
79. 24* 


Pro 
Pro 


10. 


Projector Noise 


Wk 
Wk 


4: 
6: 


85 
72 


37 
29 


(16) 
17 


(7) 




2 
3 


125. 21* 
104. 5Z'' 


Pro 
Pro 


11, 


Boredom Exper. 


Wk 
Wk 


4 

6 


1 1 1 
99 


27 
26 








1 

1 


49. 92* 
41,15* 


Pro 
Pro 



Note. Part II of attitude questionnaire = CAI milieu per se. 
' Parenthetic entries include adjacent celW's of <4. 

*_£<. 001. 

68 



ERIC 



55 

2 

were s i Ti i f i c u n t , where in each case. t5 , 0 0 1 • However, not 
all of the tests were in favor of CBL Thus, the analysis demonstrated 
that 19 tests of item significance were pro-CBI; 2 were neutral; and, 1 
was mixed (between pro/con). Item ifZ, identified as neutral on attitudes 
at both week?? 4 and 6, was "reading skill level": i, e, , neither too high 
nor too low. Item il5, identified as mixed in attitude at week 4, was "fa- 
tigue experienced": i.e., a bimodal distribution of responses, with mort 
responses lumped at "b" (65) and "d" (42), The other nine pro-CBI iten:»s 
are identified by inspection of Table 12 , and more fully described in Appen- 
dix E . 

(2) CBI ^^^ Attitude Scale Resp ^!r>. The significance of the item 
responses on the PLATO lY (CBI^p^ attitude questionnaire (part I ) is 
contained in Table 13. Given the 14 item questionnaire administered to 

both the individual-learning (I-L) and peer-learning (P-L) groups, a total 

2 2 
of 28 separate X tests were derived. Nineteen of these X tests were sig- 
nificant, with p levels ranging from < • 05 to < . 001 . In all cases these 
sij7,nificant results were indicative of pro-CBI attitudes. While 8 of the 
tests were nonsignificant, 4 of these were nierely distinctions between 
"a'* and '^b" responses only, i.e., "highly disposed" versus "sorAcwhat 
disposed" toward CBI. Thus, regardless of the X test outcome, these 
items were clearly pro-CBI. Overall, for the I-L group, II of the 14 
items were demonstrated to be pro-CBI; while, for the P-L group, 12 
of the items were found to be pro-CBI. Thu^: , botli study groups were 
highly disposed toward CBI v/ith the P-L group being only slightly more 
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Table 13 

^ Attitude toward the PLATO IV Sy. .em: by Item 
( Part I: Gps. I-L/P-L) 



56 



Attitude ' Response ]■ rcquencies !ProTC".on 

Items Gp. ^a b c cl ^'e"^' df X"^ CBI 



1. Graphics Helpfulness 


I-L: 
P-L: 


23 
47 


(12) 
(5) 








1 
1 


2.81 Pro 
32. 32 l^ro 


2. Number of Frames 


I-L: 
P-L: 


: KB 
-20 


(17) 

28' 


^4 






1 

2 


• 0 1 Pro 
17, 58 Pro 


3. Amount of Material 


I-L: 
P-L: 


21 
25 


( ) 4) 
22 


5 






1 

2 


1,03 , Pro 
1 3. 7 0 Pro 


4. Sequence of Material 


I-L: 
P-L: 


25 
26 


(1 0 ) 
(26) 








1 
1 


5, 48 Pro 
Pro 


5, TV/Q's Coordination 


I-L: 
I^-L: 


1 5 


5 
19 


•(3) 






2 
1 


';.04 Pro 


6. TV vs Computer Distr'cJ-I.: 

P-L: 




(17 ) 
(17) 


( ' ) 

(7) 






1 
1 


3.38 


7. Stopping TV Player 


1-L:^ 
P-L:^ 




( 

(15) 


(5) 




4 


C. 

2 


3, . 

9. 26 Pro 


8. Les son Lycnglh 


I-L: 
P-L: 


a 
y 


(i b ) 
(20) 


A 
•t 






i 
1 


1 ^ U 4 ^ P 1 O 
9- 3^''*' Pro 


9. Sound/Q's Coord. 


I-L: 
P-L: 


I o 
22 


1 1 
i 1 

21 


(o ) 

(9) 






2 
2 


6, 08 Pro 
6, if Pro 


10. Projector /Q' .s Coord. 


I-L:^ 
P-L:* 


(8) 
10 


4 


5 
6 


(22) 
1 3 


19 


2 
4 


13.7-f Pro 
12.26' Pro 


11. Sound/Slide vs Comput 


. I-L: 
P-L: 


9 

20 


1 7 
18 


4 

4 

•f 


(5) 
(10) 




3 
3 


1 ] . 67* Pro 
1 3. Pro 


12. Lessons Ist/Then Q's 


I-L: 
P-L: 


22 
23 


(6) 
6 


(7) 
1 1 


5 


7 


2 
4 


13.4 1j^ Pro 
12.06 Pro 


3. Lesson Leng'.r, 


I-L: 
P-L: 


12 
13 


1 5 
34 


4 


4 




3 
2 


10.54 Pro 
26.41 Pro 


1. Troubleshooting 


I-L:^ 
P-L:^ 


5 
7 


4 

8 


16 
16 


7 


(8) 

] 0 


3 
4 


1 1 . 1 1" Ncut. 
5.80 



Note. I-L = Ini'ividual-L.carniiif, Clrovip. Parenthetic entries: include 

P-L = Peer-Learning Group. adjacent cell f's of <4. 

Mtcms i^l, #10, «14: Scoring (a - e) - reversed. 



*p<.05. 

«'<'p<. 01. /U 
«'!''!^ <. 001. 



Table 14 

Attitude toward the PLATO IV Fystcin: by Item 
(Part II: Gps. I-L/P-L) 



Attitude Response Frequencies Pro/Con 
Items Cp. bed df X CBI 

1. Difficulty of Tern-iinal I-L: (24) (9) 1 5.94''' Pro 

P-L: 28 (24) I .17 Pro 

1 1. 89. ,Pro 
14.22 Pro 

3J-' i' * 

22. 7 6'' '*' Pro 

K83 Pro 

22. 67'^''^'i-^ro . 

14. 79^''^ Pro 
9, 50"^^''' Pro 

8. 62*^, Pro 
11, 24 Pro 

5. 04 Pro 
.17 Pro 

23. 0-^,.^^^Pro 

24. 04^^' Pro 

8.63.. .Pro 

5.: 5j« 'Jj: 

19.84 Pro 

1 0. Device Arrangement I-L: 19 1 1 5 2 8.46 Pro 

P-L: • 24 (28) 1 , 18 Pro 

1 K CarrePLighting I-L: (26) (9) 1 7, 3 l^^^.^^.Pro 

P-L: 42 OO) 1 18.48''''Pro 

1 2. }3ackground'Noise I-L: 18 11 (6) 2 6. 24^.^^^Pro 

P- L: 3 5 1 2 (5 ) 2 28.4 3* Pro 

1 3. Training Fatigue I-L: (28) (7) 1 11, 43^,'* Pro 
P-L: 17 26 (9) 2 8. 36'" Pro 

Note . I-L = Incli vidual-Lea rning Group. Parenthetic entries: include 

P-L - Peer-Learning Group, adjacent cell f's of<4. 

^Item i:2: Scoring (a - e) = reverse of other items. 

p<.oi. 71 
***p<:. 001, 



2, 


Keyboard Operation 


I-L:^ 






5 


9 21 


2 






P-L:^ 






(7) 


18 27 


2 


3. 


Presentation Delay 


I-L: 


?.o 


5 


4 


(M 


3 






P-L: 


32 


16 


(^) 




2 


4. 


PLATO Image 


I-L: 


22 


(^3) 






1 






P-L: 


43 


8 






1 


5. 


Screen Eyestrain 


I-L: 




(22) 


4 


9 


2 






P-L: 


27 


16 


(9) 




2 


6. 


Letter Size 


I-L: 


18 


1 3 


4 




2 






P-L: 


24 


22 


(6) 




2 


7. 


TV Casf-ette Operation 


I-L: 




(18) 


6 




i 






P-L: 


13 


(1.0) 






1 


8. 


Projector Operation 


I-L: 


2 5 


4 


6 




2 






P-L: 


34 


9 


(9) 




2 


9. 


Carrel Working Space 


I-L. 


13 


18 


(4) 




2 






P-L: 


10 


27 


7 


8 


3 
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inclined toward it than the I-L group. Also, from other points of view, 
11 items indicated significant pro-CBI responses by both the tv.'o grou}K: 
(I-L/P-L) jointly; one item {vl) displayed a pro-CBI attitude by tlie P- L. 
group only; one item (*!\4) displayed a neutral position by the I-I^ group 
only; and, one item (//6) Vv'as preferred by neither of the two groupr;. The 
findings of this part of tlie questionnaire were thu3 quite clear as to pre- 
dominant student acceptability toward CBI as embodied in the PLATO IV 
Computer- bafjed Educational System. Inspection of Table 13 reveals the 
rcepective attitude areas relating to the.se findings. 

The significance of the item responses on part II of the PIvATO IV 
attitude questionnaire are contained in Table \4, This pa.rt consisted of 
13 items for significance testing, Ar, alcove, when admi7ii slercd to both 
the I-L and P-L training groups, this yielded a totiil of 26 r.eparate X 
tests. Twenty- two of these tests were significant with p levels ranging 
from <Z * 05 to<:^. 001. In all cases, these significant results v/ere indica- 
tive of pro-CBI attitudes. As in part I of the questionnaire, while four 
2 

X 'b were nonsignificant, the results were still judged to be pro-CBI 
since the four cases in point were merely testing the distinction between 
''highly" and "somewhat" favorable tov/ard CBI. Overall, every item re- 
ceived a pro-CBI endorsement by both training groups (I-L/P-L). Thus, 
the findings of part II of the questionnaire were unanimous on student 
acceptability toward CBI as exemplified by varied aspects of the PLATO 
IV System. Table 14, and Appendix F, reveal the respective attitude 
areas relating to these findings. 
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b. Ke'un7io of Rc cults 
The ^i^titudc questionnaire findin^^s on the two CI.U systems, the D.iM 
1500 System (CBI^^j) and the PLATO IV System (CBI^^)) summarized 
in Tables 15 and J 6, respectively. The results were obtained by crosL- 
item summation. T^i.ble 15 reflects the findings contciined in Tables 11 
and IZ relating to parts 1 and II of the CBI^^ ^ questionnaire, with both parts 
being considered s: cparc^itely and jointly. Furthermore, inform^ation on 
wcelcK 4 and 6 of basic electronics training are included in the data f.x.ini- 
mary of Table 15. As dij^cussed in the analysifi of the individual attitude 

Table 15 

Global Attitude toward IBM 1 500 System: Cross Items 
(Parts I/II: V/ks 4/6) 



Attitude 


Test 


Pro 




a 

rcqucncics 


Con 




2 


Pro /Con 


Part 


Wk. 


a 


b 


c 


d 


e 


df 


■■ X 


CBI 


I 




59 


37 


ZO 


13 


9 


4 


60. 4 3*' 


Pro 




6*= 


37 


34 


Z7 


14 


1 3 


4 


i 9. 72* 


Pro 


II 


4 


46 


56 


20 


12 


4 


4 


7 1 . 57 _ 


Pro 




6 


39 


50 


20 


12 


4 


4 


51 . 04'"' 


Pro 


I/II 


4 


53 


47 


20 


12 


6 


4 


63. 93 


Pro 




6 


38 


4Z 


24 


1 3 


8 


4 


35. 68''"' 


Pro 



Cell frequencies (a - e) reversed for constancy where appropriate. 
^Week 4 N = 1 38. 
. ^Weck 6 N =: 1 25, 
*p <.001, 

items above, Table 1 5 clearly illustrates the highly significant positive 
attitude v/hich the students had toweirds the IBM 1 500 CBI System. This 
favorable disposition showed on both parts of the attitude questionnaire and 
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at the end of their CAI training (week 4) as well as alter two subsequent 
weeks of CI {week 6). This suinmalive data clearly sapport.-; the ovei- 
riding inference drawn ^rom the analysis of the individual i^ems them- 
selves that student attitudes w^re highly in favor ox CDi as represented 
by the IBM 1500 System. 

Table 16 

Global Attitude toward PLATO IV System: Cross Items 
(Parts I/II: Gps. I-L/P-i.) 



a 

Attitude Test Pro M. Frequencies Con _ Pro/Con 

d e df X CBI 



Part 


Gp. 


N_ 


a 


b 


c 


I 


Indiv. 


32 




(2 5)^ 


(7)^ 




Peer 


45 


19 


1 5 


5 


II 


Indiv. 


32 




(28)'^ 


ieP 




Peer 


50 


26 


18 


(6)^ 


I/II 


Indiv. 


33 




(26)^ 


(7)^ 




Peer 


47 


22 


16 


5 



-- 1 9.03* Pro 
(5r -- 3 13.79 Pro 



1 12.97* Pro 

2 11. 94* Pro 



-- 1 9.82* Pro 

b ^«n« 

(4) 3 19. 07 Pro 



Note . Some items not answered by all _S*s. Thus average N per gp. varied 
^Cell frequencies (a « e)reversed for constanc y where appropriate. 
^Entries include adjacent cell frequencies of 3 or less. 
*p< . 01. 

Tf. ble 16 reflects the findings contained in Tables 13 and 14 relating 
to parts I /II of the CBI^^) questionnaire, both parts considered separately 
and together. Information on the individual and peer learning study groups 
are included in the data summary. As indicated in the analysis of the in- 
dividual attitude items themselves. Table 16 clearly illustrates the highly 
significant positive attitude which the studentf; had towards the PLATO IV 
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CBI System. Thir. favorable disposition was obtained on both parts of tho 
attitude questionnaire and for both the I-L and P-L training p^roups. In 
resume, analysis of the individual attitude item responses and their cross 
iteni suniniation presented strong replicative ervidence between two CBI 
sycten:is on the desirability and acceptability of computer-based instruc- 
tion. The almost unanimous favorable disposition toward the items of 
the separate attitude questionnaires by the two study roups demonstrated 
a strong commonality between them on preferring CBI. 

CBI^jj vs CBI^2j' E>'pressed Opinions 

a. Basic Approach/Results 
Besides Likert items, both questionnaires included selected open 
ended items designed to elicit student comments regarding the respective 
CBI systems. The response to these items was typically varied. Y.'lnle 
certain items drew only a few comments, other items elicited comments 
from the entire sample. These expi-essed comments were subjected to 
a content analysis v^^hich yielded a variety of dimensions and sub-areas 
of attitude and opinion toward CBI. The relative importance of each dimen- 
sion/sub-area v.'as determirr:!: no(ely by the empirical evidence of com.- 
ments tabulated for each ^irea, '^."he student responses were voluntary 
comments to two separate perspectives to CBI: global attitude toward 
CBI, and specific attitude tov^ard individual CBI areas of interest. By 
design, it was intended that the general vice specific items, as well as 
the Likert versus open ended item format discussed earlier, would com- 
plement one another for a more thorough view of student attitude /opinions 
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toward CBI. 

The result*: pertaining; to the f^ciierali ^ed expressed conimcnir. l^y the 
IBM 1500 (CBI^j^) sample are contained in Tables 17- 1^; and, the re- 
Bults of the generalized expressed comments relating', to the PLATO IV 
(CBI^2j) ^'''niple are contained in Tablef, 20-21. Regarding student ex- 
pressed comments toward specific attitude items, solicitation of comments 
was productive for tlie CBI^^^ sample only. The latter findings are con- 
tained in Tables 22-23. For appropriate attitude interpretation, it should 
be noted that the training context for ihc group consisted of an in- 

tensive four week CAI course on basic electronics, wliile the CBI, , Qroup 

(2) ^ 

consisted of a set of mini-lessons on .similar subject matter and repre- 
senting about 6 hours of cla.ssroom material. For both situa^ionf most 
subject matter waj: taught on-line, with occasional segments (pe rforrjianco 
exercises and other m.^iterial) being taught off-line. In both caseL., the 
student sariiplo consisted of regular Army enlisted personnel v.-ho were 
conimencing basic electronics tiaining. As noted in earlier sections, the 
study setting was a real-time operational one. The basic expressed opin- 
ion results are presented in sections (l)-(3) below. 

(1) General Comment Areas: CBI . The CBI was asked 
— ' — ~ ■ ^{1/ (1/ 

three gencrali::ed opinion questions as indicated by items 12, 13 and 14 
of Appendix K(part II). Tliese questions concerned; comparison of CBI 
with CI; things liked most about CBI; and, things disliked most about CBI. 
The findings are as follows. 
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Tabic 17 

Exprcfiticd Comments on CBI vg CI: General 
(IB.M ir>00 Gp. ) 



Generic / SuL 
Opinion Areas 



Pro CBI { 



o Individuali/ecl/Self- Paced Method 
-Prefer self- paced method ]5 
-Provides more attention 2 
-Have Own equipment 2 
-Have own'instructor" 2 
-Provides independent training 2 

2? 

o Training Conditions /Milieu 
-More comfortable 
-Less boring 
-Less distraction 
-Less tiring 



o Miscellaneous Opinions 
-Can use time better 
-Covers course v/ell 
-Better than good instructor 
-Sticks to subject well 
-Instructor is more free 
-Material is well planned 
-Can take notes easier 
-Increases retention 
-Better as ^ teaching aid 
-Permit S's to choose CAI 
-Use more CAI 

o General Disposition 

-More effective than CI 
-Holds interest more 
-Can learn faster with CAI 



14 
5 
1 

_1 

zf 



3 

7 



14 



Generic /Sub 
Opinion Areas 



Pro CI f 



o Inquiry /Interactive Potentkil 
-Better for asking Q*6 
-Facilitates reviewing 
-Facilitates discussion 
--Good for tutoring 
-Promotes interaction of S*s 



Y 

-Facilitates S^yj^ interaction 

o Jvliscellancous Opinions 

-Requires less pr e- knowl 'ge 
-Gives less but enough info. 
-Requires less verbal skills 
-Is more informcitive 
-Requires no back-up aa CAI 
-Ib more specific 
-Facilitates retention 
-Is not superficial on details 

o Fatigue 

-Requires less patience 
-Not repetitious as frames 
-Not tiresome as CAI 

o General Disposition 
-CI is better 

-CAI/CI value varies with S 
-Both CAI/CI are are bad 



14 
3 
1 
1 

1 
1 

21 

1 
1 
1 
1 
1 
1 
1 

8 



2 

5 

6 
1 

8 

IT 



95 



= frequency count. 
= Student(s), 
I Instructor. 
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(a) Comnient Area: CRI vs CI, The results of the first 
question arc contained in Table 17. By desipn, the expressed comments 
fell into two categories, pro-CBI (denoting CAI primarily) and pro-CI. 
Overall, it itJ noteworthy Ihc'it the majority of the responses (697c) were 
pro-CBL Inclusively, of these, a total of 95 pro-CBI comments were 
subdivided into: general disposition (37); training conditions/atmosphere 
(23); individuali/-ed self-paced approach (21); and, miscellaneous (M)c 
Within these, based on the comparison with CI, specific emphasis v.ms 
placed on the following item topics: CBI is more effective (18); CBI pro- 
videt' more comfortable training (16); prefer self-paced CBI (15); ar. 1, 
CBI holds on'c's interest (14). Conversely, 31% of the responf.cs were 
pro-CI. In this regard, a total of 42 expressed comments W':^re obtained 
These were subdivided into the broad areas of: inqui ry /interactive po- 
tential (21); general pro/con comments (8); specific pro/con comments 
(8); and, fatigue (5). Regarding these broad opinion areas, emphasis 
was placed on the following topical areas: CI facilitates asking questions 
(14) and reviewing/interacting v/ith instructor and other peers (7 total). 
Other comments were expressed but were not supported with any large 
concensus of opinion. 

(b) Comirtent Area: Positive Aspects of CBI . The results 
of the second question, regarding what is liked most :!bout CBI, are 
contained in Table 18, The total number of comments made on this ques 
tion was 157. The logic of these comm.ents yielded the following four 
opinion categories and their respective frequencies: CBI (i* e. , CAI) 
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Table 18 (^5 

Expressed Comments on V/hat Studcntc Like about CBI: General 

(IBM 1 500 Gp. ) 



Generic/Sub 
Opinion Arear> f 



o CBI Milieu 

o Training Conditions /Atmosphere 

-Good learning environment 22 

-Informal conditions 18 

-Comfortable conditions i(y 

-Air Conditioning 12 

-Smoking in class 5 

-Quiet conditions 5 

-Good training hours 3 

-Training breaks 1 . 

-Very personal treatment 1 

-Not boring j 

84 

oCBI Instructional Methodology 

o Tndividaalized/Self- Paced Method 

-Like learning at own rate 36 

-Have own equipnient 4 

-Make better use of time in CAI Z 

-Similar to self-tutoring text 1 

-Instruction is more personalized 1 

-Can learn faster v/ith CAI 1 

-Like the style of CAI J 

46 

o Course/Lesson Material 

-Course presentation is good 4 

-Can learn easier with CAI 3 

-Lessons ordered logically 1 

-Quizzes are related well to course ] 

-Like the practical exercises j 

o CBI Equipment 

-CAI terminal is effective 1 

-Keyboard entry is good 1 

o General Disposition 

-Like everything about CBI 9 

-Like few things /nothing about CBI 6 

Ts 

157 

Note. The IBM System ~ CAI pr ima r ily/ with some CMI. 
~ frequency count. q 
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milieu (84); instructional '"^^-othodology (56); ncne.ral comments (15); and, 
CAl equipment (?.)• Thur.* ^ha Opinion Catop^ory receiving the most attcii- 
tion was "CBI milieu" (5-i^^); ^.nd, the other arf"-a given mORt focur> was 
"instructional methodolof,y" (36%), V/ithin these t\vo topics, the sub-areac 
students most liked abovit ^hl Wer^': lcarni^^g at one's ov^n rate (36); good 
learning almof^phcre (22); ^^id, comfortable conditions (l6). 

(c) Covrvn2J^^ of_CBl^. The rcr.iilts 

of the third question, con'^-^^'ning what is dijjjil'.cd most about CBl, are 
contained in Table 19. T^'^^ total number of comments made was lOZ, 
The.se comments yielded ^''^^ broe>d opinion cat^^gories and their respec- 
tive frequencies as foilowi^'' instructional methodology (41); C13I instruc-- 
tors (11); CBT (io , CAI) "niieu (10); CbI equipment (9); mi r.celianeous 
comments (8); and. an asi^^^'tment of goncral comments (23). V/ithin 
these opinion areas, the b'P^^cific topics receiving the most ailcn^ ion were: 
course presentation is too ^^^st (8); poor in53tructor attitude (8); learning 
level too difficult (7); too I'^^ny hours via CAl (6); and, can't repeal: frames 
(5). Noteworthy among al^ ^he responses made was the general comment 
that noth-'i:ig was disliked c^^^ut CbI (23). 

(2) Genera l ^CaJIlrn e n tjV r e ^ Bi^ ^ ) - The ^BI^^^ study group 
was asked one general quc^^ion i\Q indicated by item I 4 in Appendix F • 
This question addressed s^^^ent opinion toward CBI over an extended 
period of time. The findir^^^ we^-c subdivided first according to the two 
PLATO study groups (I-'l/^^'L) an<^ next according to the respective sub- 
topic areas of expressed oP^^ion (c^- Tables 20-21). 
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Table 1 9 

Kxprenf^erl Conunentfi on What St udonts Dislikr; about CBI: Cc^ 

(IBM 1 500 Gp. ) 



Gei^eric / Sub 
Opinion Areas 

o CBI In.structional Methodolo[',y 

o Course Content 

-Too many hour.- on CAI 

-Too much reading 4 

-Too much detailed information 3 

-Lessons are long/boring 1 

-Too much homework j 

-Need more time on Q's • \ 

o Course Presentation 

- Too fast g 
-Ins. X actor called too fas t./oftcn \ 

o Course Level 9 
-Learning is difficult 7 
-Too competitive j 

o Coursk* Rc /ievv' S 
-Can't repeat frames 5 
-Cc-^n't ask Q*s 3 

o CBI Instructori^ . S 

-Poor instructor attitude 8 
-Can't get instructor's attention 2 
-Need more instructors J 

o CBI Milieu 1^ 
o Training Conditions 

-Too confinod/isolatcrl 4 

-Change class hours 2 

-Tootiring 1 

-Too quiet/boring j 

-Background noise j 

-Light pen use is tiresome 1 

o CBI Equipment 

-Downtime is annoying 9 

o Miscellaneous Opinions ^ 

"Need more Performances Exercises 3 

-Reviews easy/ tests hard 3 

-Too impersonal /repetitious • 2 

o Generc'il Disposition 8 

-Nothing Disliked 23 

lOZ 

Note . The IBM : ystem - CAI primarily /with some CMl. 
- irequency countv 
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(a) Comments by the I-L Group . The results for the I-L 
study group are contained in Table 20, A total of 57 I-L student comments 
were obtained. These comments yielded four opinion categories and their 
respective incidence as follows: CBI training (general) (45); fatigue (6); 
carrel configuration (1); and, a set of miscellaneous comments (5). As 
indicated, the predominant area of opinion was the generalized area of 
CBI training which attracted 79% of the comments. Within the opinion 
categories, the following specific topics were of prime interest: CBI is 
a good teaching system (15); self-pacing is fine (7); and, need more in- 
structor support (6). The remaining subtopics were not supported by any 
sizeable concensus of agreement by the student sample to be noteworthy. 

(b) Comments by the P-L Group. The results of the P-L 
study group are contained in Table 21. A total of 108 expressed comments 
were obtained. These comments yielded four broad opinion categories 
and their respective frequencies as follows: CBI training (general) (72); 
carrel configuration (17); fatigue problems (11); and peer /individual 
lea rning (8). Quite clearly, the major opinion areas of interest were the 
positive and negative aspects of. CBI training (67%). Within these opinion 
categories, the highest incidence of comments centered around the follow- 
ing subtopics: CBI is a good teaching system (17); the carrels are too small 
a?); can work better at one's own pace (11); CBI is better than an instructor 
(11); CBI (specifically CAI) is boring over an extended time (9); and, an in- 
structor is needed with CBI (8). The remaining subtopics did not draw 
enough support to be given further special mention. 
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Table 20 



Expressed Comments toward CBI: General 
(PLATO IV: I-L Gp. ) 

Generic /Sub 
Opinion Areas 



o Fatigue 



o Miscellaneous Opinions 



oCBI: Positive /Negative Aspects 

o Positive Aspects 

-Good teaching system 15 

-Self-pacing is fine 7 

-Good for taking notes 2 

-Less boring than instructor 2 

-Keeps you busy 1 

-F ise via computer helps lecining 1 

-All students get Q's via CBI 1 

-Instructor is more free 1 

30 

o Negative Aspects 

-Need more instructor support ^ 

-Training hours too long 2 

-CBI requires other media too 2 

-Some topics require more CBI time 2 

-Just reading (CAI) is not good 2 

-Computer talks back too much 1 



15 



-Fatigue is not a problem 3 
-More breaks will reduce fatigue 2 
-Fatig\ie is a problem 1 



o Carrel 



-Permit students to back up on CAI 2 
-Permit students to ask Q's on CAI 1 
-Motivation is more important than method 1 
-CAI requires greater attention/concentration 1 

~5 

- Ca.rrel is too small 1 

57 



EKLC 



Note . The PLATO System = CAI primarilyVwith some CMI , GDI, 
~ frequency count. 



Table 21 



Expressed Comments toward CBI: General 
(PLATO IV: P-L Gp. ) 



Generic/ Sub 
Opinion Areas 



o CBI: Positive /Negative Aspects 

o Positive Aspects 

-Good teaching system 17 

-Can work at own pace 11 

-Better than instructor g 

-Holds attention ^ -r-ll 4 

-Ideal if desire l*-^ rn 2 

-Not boring 1 

-Faster learning possible 1 

45 

o Negative Aspects 

"Boring over extended time 9 

-Need instructor also S 

-N-3ed better chairs 5 

-Need r ore variety in media 3 

-Too much reading 1 

-Instructor is better 1 



o Carrel 



o Fatigue 



27 

-Carrel is too small 17 



-Causes eye fatigue 4 

-Get sleepy reading too much 3 

-Get tired of sitting 2 

-Need more breaks 2 



o Peer /Individual Learning 



11 



"Peer learning is fine 4 

"Individu-^l learning is OK 4 

8 



108 



Note. The PLATO System = CAI primarily/with some CMI, CDL 
M = frequency count. 



84 



71 

(3) Specific Cor-nment Areas: ^^^ '^o)* indicated earlier, the 

CBI^^j study group was not productive of expressed comments to individual 

attitude items. As shown in Tables 22-23 even the (!) DI^^j study group did 

not express very many comments on the specific attitude items. This is 

so because such comrrients were purely voluntary. It can be assumed 

that expression of comments reinforces their value regardless of the total 

number obtained. Given this limitation, the CB'^ opinions derived from 

(2) ^ 

the specific attitude items are available for review and analysis in this 
section. The items referenced here are contained in parts I/xi of the 
PLATO IV attitude questionnaire as indicated in Appendix 1^ , The ex- 
pressed comments were summarized along two perspectives; the study 
groups involved (I-L/P-L) and opinion categories, 

(a) Comment Area: CBI Strate<vies , The results for the 
I-L/P-Li study groups regarding their expressed opinions toward three 
specific CBI strategies (CAI/CiMI/CDI) are contained in Table 22. A 
total of 58 comments were obtained. These were categorized both accord - 
ing to the two study groups and the three CBI strategies as follows: the 
I-L group: three D. C. 1 r^damentals lessons (9); one First Aid lesson 
(3); and, one Troubleshooting lesson (12). (representing CAI/CMI/CDI 
type lessons respectively); and, for the P-L group: (ibidem) 15, 6, and 
Irrespectively. Noteworthy among the I-L opinion subtopics were: pre- 
fer questions throughout CBI lessons - not just at the end (10) and graphics 
are very helpful (5). Likewise, noteworthy among the P-L opinion sub- 
topics were: require more material in electronics (7) and graphics are 
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Table 22 



Expressed Comm^-nts within Three CBI Strategies: Specific 
(PLATO IV: I-L/P-L Gps. ) 



Les sons / Strategies 



Study Group 
Comments 



o Three D. C. Fund. 
Lessons. (CAI) 
(Items 1-4) 



A. Individual- Learning Group 

-Graphics very helpful 
-Require more hours on 

Ohms Law/Resistance/ 

Parallel Circuits 



5 
9 



o One 1st Aid /Safety 
Lesson. (CMI) 
(Items 5-8)^ 



Length of lessons OK 



o One Troubleshooting -Q*s throughout lesson 



Lesson. (GDI) 
(Items 9-14)^ 



better than all at end 
■Slide labels useful to 
synchronize projector/ 
computer Q' s 



10 

12 



o (Ibidem) 



o (Ibidem) 
o (Ibidem) 



B. Peer-Learning Group 

-Graphics very helpful 
-Too few frames on D. G. 

Fundamentals 
-Too much superfluous material 

-Lessons too long 
-Lessons too short 

-Q*8 throughout lessons better 

than just at the end 
-Too much repetition 



Note. GBI strategies (C AI/GMI/GDI): defined in glossary, 
^£ = frequency count. 

^'Cf. Part I of PLATO attitude questionnaire: Appendix F. 
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16 
3 
_3 
6 
7 

_4 
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very helpful. 

(b) Oomn icnt Area: CBI ^^^ Terminal /Milieu . The results 
for the I-L/P-L study pror.ps on their opinions of the CBI PLATO IV ter- 
minal/milieu are coi .lined in table 23, A total of 63 comments were (ob- 
tained between the two study groups. As in the preceding, section, these 
comments were subdivided according to the two study groups and the opt - 
ion areas relating to the PLATO IV terminal and work areas as follows: 
the I-L group: fatigue (1 1); and, ter minal / work area (15); and, the P-L 
group: fatigue (12); and, terminal /work area (25), Noteworthy among the 
I-L opinion subtopics were: more frequent breaks needed (4); glare on 
screen bad (4); eye fatigue (3); and, more orientation on equipment use 
desired (3)« In contrast, noteworthy among the P-L opinion subtopics 
were: carrel is too small (12); sitting sessions too long (4); eye fatigue 
(3); more orientation needed on keyboard use (3), Other comments re- 
ceiving less emphasis than those just stated are contained in Table 23 
for inspection, 

b. Re«ume of Results 
The findiugs on the student expressed comments indicated a number 
of g^^iiC.ral :i.rca?> and specific topics of student interest and concern. In- 
cluded in th - findings were both positive and negative aspects of CBL A 
variety of comnienf ^ vere generated by the open ended format of the atti- 
tude/opinion questio maires for the CBI (IBM System) and CBL (PLATO 

( 1 ) V ^) 

Systerri) study groups. Based on the highest incidence of comments ob- 
tained on the CBI^jj questionnaire, the prime areas/topics noted are \ 
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Table 23 

ExpresBcd Comments toward CBI Terminal /Milieu: Specific 
(PLATO IV: I-L/P-L Gps, ) 



Generic /Sub 
Opinion Areas 



A. Individual- Learning Group 



o Terminal/ Work Area 



o r atigue 



-Too much glare on screen 

-Letter size too small' 

-Carrel space is sufficient 

-Carrel lighting is poor/ room n<: / 

-Need more information on equipment use 

-Use TV cassette throughout .esson 

-Improve slides 

-Computerized training is too fast 

-More frequent breaks needed 
-Eye fatigue experienced 
-Mental fatigue experienced 
-Sitting sessions are too lung 
-No fatigue experienced 



4 
2 
1 

2 
3 
1 

i 

_1 
15 

4 
3 
2 
1 

_1 
11 



B. Peer-Learning Group 



o Terminal /Work Area 



o Fatigue 



-Carrel is too small 

-Zndary devices built-in too low 

-Need more information on keyboard use 

-Need frame backspacer 

-Too much glare on screed 

-Zeroes 5ook like o's 

-Letter siz" is OK 

-Room is noisy 

-Room is too cold 

-Terminal downtime was annoying 

-Sitting sessions too long 

-Had eye fatigue with CRT/slide projector 
-CBI was not boring 

-Degree of boredom same as with CI 



12 
1 
3 
2 
2 



Note. 



The PLATO System 



25 

4 
3 
3 
2 
12 



J_ = frequency count. 



CAI primarily /with some CMI, CDI. 
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•J -I .id as Jollows: (a) CBI vs CI positive aspects: CBI is more effective 
than CI, CBI atmosphere is better for learning, students prefer self-paced 
learning, CBI holds'one'B interest; and, negative aspects: CBI is not suit- 
able for asking questions/review of material (i. e. , CAI specifically as 
it was designed for administration to these two study groups. Other 
available configurations circumvent these problems); (b) CBI preferences: 
like CBI self-pacod method, like CBI training conditions (informal/com- 
fortablc); and, (c) CBI dislikes: instruction is too fast, poor instructor 
attitude, and learning level is difficult. Similarly, based on the CBI 

(2) 

questionnaire, the prime areas/topics for the I-L/P-L groups are as 
follows in rank order of importance: (a) I-L group: CBI is a good teach- 
ing r.ystem, self-pacing is fine, and need more instructor support; and, 
(b) P-L group: CBI is a good training syste; , (PLATO IV), self-pacing 
is fine. CHI is better than an instructor, CBI can be boring if too long, 
and inot-u-:! r bupport is needed. 

: vt? nndings were derived from student responses to a few 

generalix :d type questioi addressing global pro's and con's of CBI, Also 
included in the CBI questionnaires were a number of select items directed 
at varied specific aspects of CBI (as exiimplified by the IBM 1500/PLATO 
IV Systems). Voluntary expressed comments to these items were like- 
wise tabulated and pooled i.xto cluster areas/topics of opinion. These 
findings are distinguished by study group (individual /pe er learning modes) 
and item subset. As explained earlier, the CBI^^^ group provided no sub- 
stantive comments to report. Thus, the below resultr, reflect the CBL . 
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group opinions only. The essential results relating to part I of the C^^^^) 
questionnaire are given in rank order as follows: (a) I-L group: questions 
are preferred Ihrougliout lessons not just at the end, and graphics are 
very helpful; and, (b) P-I. group: need more material on electronics, and 
graphics are very helpful. le prinrve results relating to part II of the 
same questionnaire are given in rank order of importance as follows: 
(a) I-L group: more frequent breaks needed, and too much glare on the 
screen, (also some emphasir. r^iven to eye fatigue and need for more 
orientation on equipment use); and, (b) L group; carrel too small (due 
to peer "raining two students occupied a carrel at once, thus being over- 
crowded), and need more orientation on keyboard use. 
C. ISSUE C: Factor s /Relationships Unique to CB^ 

The issue addressed in this section is concerned with the factr s 
and relationships unique to CBL Due to the infancy of CBI, insight into 
the factors associe^ted with it, for possible manipulation and control, is 
^.tt yet in the exploratory stage. Three areas are given focus in this sec- 
rion: an identification and description of pre/on-going training parameters 
relating to CBI; inferences lor optimizing CBI operationally; and, poten- 
tial CBI aspects for further research and evaluation. The results and 
analysis of tl.a 'irst area will be considered in this section. These will 
serve as the bases for inferences and recommendat* ons to follow. The 
design basis for analysis oi this issue consisted of four major training 
criteria: achievement (written/ per formance) , cor^zr" ' ** " t*me and pass/ 
fail incidence. The evaluation approach will basically consist of qvian- 
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{J**' t^fjrrrlati^'"' ^^.xli^^^ ^ 'He available pre/on-goinn trainin,. 

\ for the ^"^1) ^^°°) study group. This group was selected 

U pro^'icK^'' '^\^r(^ ^^'^''^^^'^tative sampling of students (N-139). 
^^"^ \^terial, i*" *^"^Ui.ge ^^'^^^les. As with the prior two issues, a 
y'"^'^ \ ,f the fii^P^^^^^itipl'^ "^-elational results will be given. This 
^ \<)'' ^ des^^''''''^'^n o£ the approach, sample of students and course 
^^'^''^ ^mploye^. "-^'^ ^ ^e^ume of ^^tained findings. 
^ B.lati°'^'S.: 5i^P^'= Correlations 

5^i(]eri the ^ o/' '^^^'^ent and attitude measures presented 

ov 

^ > and p abov,,^ ^ ^^rrelationai analysis of these meacures yet 



detern^i'^' ' ^Og^ factors ^nd relationships peculiar to CBI. 

^\-^ \,cal tech^^'l"^^ Of c^^'"^^^*^"'^al analysis, both simple and mul- 

regi-e5^^°"' ^v^j.^ ^elected uncover these relevant aspects 

^/ \r^^ siinpJ^ ""^^^tiojj^hiPS ^^ong the available measures, includ- 

^ U^^^^^ ^^^^^^rd ^^^^^^^^^ons, are contained in this subsection; 
^iJ^^ nshi udin 

^t^^ rclati'^" ^s, ^^^1" ^"g ^^ctors specific to predicting each 

s/ critc^-i^' '"^^^ cor't^^"'^^ in the next subsection (C, 

^ ^ample ^^°"^^^te^ ^"^^^sted regular Army students par- 

y./'^^ \ the A^-^y ^ ^^siC ^^'^'^^i-onics course. The CBI course seg- 

^^"t \i6ted Of tl^^ '^st j^c7 ^'^^^s Of basic electronics (i. e. . 42 hours). 

Y^*^^ \^/cn-goi^^ '^'^^'^ing f^°^^^*-es .^ere obtained on all CBI students. 
{^^' ^""^ ^ ''^'"^^ble J^^^'"^''^'=finition). These consisted of eight 

y^^^"^ ^'■''''^ior, v^^'^^^^s \^hich were subjected to a corr-- 
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lational analysis which follows below. The basic correlation nnatrix for 
the 12 variables is contained in Table Z4. Noteworthy among the 66 cor- 
relation^ coefficients (Pearson Product- Moment ) generated was the high 
relationship of the predicted score variable itself (-. 68 to . 63) v/ith each 
of the four criteria. The next highest set of correlations in order of mag- 
nitude with each of the criteria was the Army Aptitude Electronics Score 
56 to . 50). With respect to the latter measure, it should be noted that 
it formed the basis for the predicted score variable itself. Thus, as 
indicated in Table 24, the correlation between these two variables is 
quite high at .79. Remarkably, the next two best predictors are the 
attitude measures, attitude- 1 and attitude-*^, with validity coefficients 
ranging from -.17 to . 37 between these two variables respectively an ' 
the four criteria. The correlation between the attitude measures was 
.49. The variables of education and written test time rank next highest 
in correlation with the criteria, with coefficients ranging between -.15 
to . 32. Lastly, the performance test time variable demonstrated low 
or no correlation with the criteria (-. 03 to . 09). Regarding the inter- 
correlations among the predictor variables themselves, it is interesting 
to note that except for the two coefficients noted above (i.e., .79 and .49), 
the remaining coefficients are uniformly low (-.24 to . 31). As will be 
seen in the following section, these low predictor correlations are ad- 
vantageous toward contributing unique variance in the derivation of mul- 
tiple R.^ (matrix variance explained) for each of the four criteria treated 
separately. 
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Table 24 

Correlation Matrix: Phase I Variables 
(N = 139) 



2 

Variables 


3 


4 


5 


6 


7 


8 


9 


10 


I 1 


12 


M SD 


1. Age . 1 I 


. 04 


-. 02 


. 09 


. 20 


. 1 2 


. 15 


. 04 


. 00 


-. 03 


-. 07 


ZO.^A 2.43 


2. Educ. 


. 16 


. 31 


. 03 


-. 08 - 


-. 14 


-. 08 


. 32 


. 22 


-. 22 


. 17 


12.26 1.38 


3. Elec. 




. 79 


. 05 


. 05 - 


■. 12 


-. 04 


. 50 


. 45 


56 


. 28 


i i 9. 33 12. 65 


4. Pred. 






. 14 


.11- 


■. 24 


-. 14 


. 63 


. 60 


68 


. 43 


102. 64 10. 44 


5. Attit. - 1 








.49 


. 05 


. 07 


. 32 


. 33 


17 


. 20 


46. 75 9.41 


6. Attit. -2 








- 


. 04 


. 00 


. 37 


. 31 


-. 29 


. 23 


41.79 4.89 


7. Writ. -Time 










. 24 


-. 15 


-.21 


. 25 


-. 20 


61. 83 11. 90 


8. Perf. -Time 












-. 01 


03 


. 09 


. 05 


59. 49 5. 49 


9. Writ. -I 










1 






. 78 


-.67 


. 69 


77. 42 13. 92 


10. Perf. -I 


















68 


.71 


80. 88 13. 31 


; 1. Time I 




















56 


34. 76 15. 30 


12. Pass/Fail I 




















. 88 34 


^^For N 
For N = 


139. 
139. 


P " 
P ^ 


. 05 where 
. 0 1 where 


r = 


. 16. 
. 21 . 













93 



80 

Variables 1-3 (cf^ Tabic Z I) arc designated ae prc-CBI measures 
since they are derived from the student's Army Bafiic Test Battery re- 
cord; variable -l a predicted score based on a regression designed to 
predict student phase I perforn nee in basic electronics. Variables 5-8 
represent other training measures available on all students through special 
testing* Variables 9-1?- a* ft the four official criteria of student perfor- 
mance. Besides tho si a. pie inte rco r relations , Tabic Z4 provides means 
and standard deviations on all 12 variables for inspection, 
b. Resume o: Results 

A total of 66 correlations were obtained from the matrix of IZ var- 
iables. These measures consisted of the following: three pre-training 
variables, one predicted score, two affective measures, two test time 
measures and four training criteria. As expected, the best predictor 
was the predicted score itself based on a regression equation derived on 
an earlier student sample and cross- validated. The remaining predictors 
were lifted successively in rank order of their importance toward pre- 
dicting the criteria. Further, it was noted that the predictor variable^; 
a a whole exhibited low correlations among themselves. This repre- 
sented a or ; o the subsequent multiple regression analysis since low 

interrelated predictors bear a high potential for contributing unique var- 

2 

iance in the derivation of multiple R. (criterion variance explained). Fi- 
nally, further description of the pre/on-going CBI parameters was pre- 
sented through their respective means and standard deviations 
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CAM lU'lationshiptt: Multiple Correlations 

a, Basic Approach/J^csults 
Afi noted above, bcsid<is simple descriptive correlations, a more 
comprehensive analysis of CBI factors and relationships requires an 
examination of tl.o variable correlation matrix from a multiple correla- 
tional poir\t of view. The same student sample and variable set as dis- 
cussed immediately above is used* The correlation matrix was sub- 
jected to a Wherry-Doolittle Test Selection procedure which is a modi- 
fied form of the Doolittle complete f.olution of a correlation matrix for 
the computation of multiple R (variance explained). Effectively, the 
Wherry-Dolittle procedure determines the minimum number of variable! 
to predict a criterion while attaining the maximum R possible within a 
given matrix. The variables selected under this procedure contain non- 
overlapping variances and, as such, are considered unique - specific pre 
dictors of a given criterion. Garrett (1958) describes and outlines the 
Wher ry-Dolittle procedure within the context of test selection where a 
small battery of tests is desired for effective prediction purposes. The 
multiple linear regression analysis was conducted through the statistical 
package of the PLATO IV Computer-based Educational System, located 

at the Computer-based Educational R.esearch Laboratory of the Univer- 

2 

sity of Illinois, Besides R , ihe array of regression statistics is also 
presented. This includes: shrunken II, raw score weights (b's), stand- 
ard score weights (B'.s), standard errors of both b and B, constant /inter 
cept (K), and analysis of variance (ANOVA) summary of regression vice 
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error vari.Mu-<: «»x|)laiiuul. Since the analytic Rcenario for Wherry-Doo- 
littlc computation of involves several reji;ros6ion Btepji, of which tlie 
final Btep is of most interest, the b'.-»low ciiscusnion will pres<MU only the 
final regression r t.i U :>t u. '{ for each of the four training criteria asnessecL 
The full stepwise re^;ies'.ion analysis for cacli of the criteria is contained 
in Appendix I , A summary Table containing the main results of each 
Wher ry-Doolittle iteration will suffice for discuBsion purposes. 

Table 25 



Final Step of Stepwise 


r 1. Tf s:-ion Analysis: I 






Criterion: 


•ten Test I 






(.'■ 


4} 




Regr cs sion 




Selected 


V..ri-,bl.>^ 


Factors 


Stati Stic s 


Measures 


(Sample N) 


(139) 


Criterion Used 


o 


Residual Variance 


94. 69: 


Predictor Entered 


5 


Re sidual S, 


9. 73 ; 






Std« Error of Mean 


. 82 . 






Multiple Ji 


. 725 






Multiple 


. 525 






Shrunken 


. 515 






Constant (Intercept) 


-59. 000 








ANOVA of Regression Analysis I 




Source 


SS 


df MS 


F 


Regression 


14051. 12 


4 351 2,78 


37. 10 


Error 
a 


12688. 59 


134 94.69 





Cf. Table 24. 

(1) Criterion 1: Writ > - n Test . The final step (//4) results of 



regression analysis I, employing the written test as the criterion, are 
contained in Table 25. As indicated, the magnitude of t^e multiple corre- 
lation (R) attained was . 725 which translates into R^ = , 525 for the degree 
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of criterion variance explained. The ANOVA results for the final step 
of this regression analysis was highly significant with a.n £ of 37. 10 , 
where df = 4, 1 34 and < . 001 . 

Table Z6 

Summary of Stepwise Regression Analysis: 1 
Criterion: Written Test I 



Regression Cumulative Shrujiken 

R R"^ 



Steps 



1 .630 .397 .397 

2 .699 .488 .485 

3 .719 .517 .510 

4 .7Z5 .5Z5 .515 

Yaria'blcs's elected k " " Constant B 

Final Step (4)^ Weight _ (Int_er_ce_pt) _ _ _W_eight 

Pred. Score • 708 • 531 

Attit.-2 .778 -273 

Educ. 1.756 ■-174 

Attit.-l .158 .107 

-59.00 

Regression Equation ^ . 708X, + . 778X, + 1.756X_ + . 158X - 59-00 

(Rav/ Score) 4 o ^ 

^Variables rearranged in rank order of their B Vw-esghts. 

A surniTiary of the complete stepwise regression for this criterion 

is contained in Table 26. With each successive step, it can be seen how 
the cumulative R increased with the addition of other predictor variables 
providing unique variance to criterion prediction. T?ius, R increased 
from . 630 in step 1 to . 7Z5 in step 4. at which point overlapping of var- 
iance explained with the other predictors in the variable set was achieved 
at the level indicated by the shrunken R^ of . 515. AJso contained in Table 
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26 are the raw (b) and standard (13) score weights for the predictor set 
selected. The raw score wei{;hts form the basis for directly predicting 
the criterion (written, test I) as effected by the regression equation con- 
tained in Table Z6. This equation is perhaps the single most practical/ 
operational end result of regression analysis. In contrast, the weights 
provide an index for appraising the relative value of the selected battery 
of predictors. For example, for the purpose of predicting the criterion, 
the predicted score variable (B=.531) is approximately twice as effective 
as Attitude-2 and five times more so than Attitudc-1. It should be noted 
that in this and succeeding Tables the predictor set selected for each 
criterion is ranked in an order of variable effectiveness (size of B weights). 

Table 27 



Final Step of Stepwise Regressior. Analyses: II 

Criterion: Performance Test I 
(Step 3) 



R egr e ssion 




Selected 




Factors 


Statistics 


Measures 


Variable^ 


(Sample H) 


(139) 


Criterion Used 


10 


Residual Variance 


100. 994 




6 


Residual S, D. 


10. 050 






Std. Error of Mean 


. 852 






Multiple R 


. 665 






Multiple 


. 442 






Shrunken 


. 434 






Constant (Intercept) 


-23. 530 








ANOVA of Regression Analysis II 




Source 




-df MS 


F 



Regression 10813.32 3 3604.43 35.69 

Error 13634.19 135 100.99 



*Cf. Table 24. 
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(2) Criterion 2: Performance Test I , The final step (//3) re- 
cults of regression analysis II, using the performance test as the cri- 
terion, are contained in Table 27. As indicated, the R attained was .665 
which translated to an of .442 (variance explained). The ANOVA re-^ 
suits for this regression step was highly significant with an F of 35,69, 
where ^ ~ 3, 135 and 2.<. 001. 

Table 28 

Summary of Stepwise Regression Analysis II 
Criterion: Performance Test I 



R egression 


Cumulative 


Shrunkc n 


Steps 


R 


K 


1 


1 


. 600 


. 360 


. 360 


2 


. 649 


. 4ZZ 


. 418 


3 


.665 


. 44Z 


; 434 


Variables Selected 


b 


Constant 


B 


- _Fjnal _Step_(3J'^. 


_Weight_ 


^Intercept) 


_Wei_ght 


Pred. Score 


.711 




. 558 


Attit-1 


. Z4Z 




, 17 1 


Attit-Z 


. 448 


-Z3. 53 


. 165 


Regression Equation 

(Raw Score) ^ ~ • 


711X4 + . 24ZX5 + 


. 448X^ - Z3. 53 



Variables rearranged in rank order of their B weights. 



A summary of the complete stepwise regression for this criterion 
is contained in Table 28, The cumulative R ranged from . 6OO in step 1 
to . 665 in step 3. The corresponding increments in R^ and R^ are like- 
wise included in this Table. Also noteworthy is the raw score regression 
equation to predict the criterion; and, the fact that again the predicted 
score variable contributed most to criterion prediction, and both attitude 
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measurea were selected. The repeated selection of both attitude meas- 
ures underscores their value in CBI. 

(3) Criterion 3: Time to Complete L The final step (//3) re- 
sults of regression analysis III, using completion time as the criterion 
are contained in Table 29. The maximum Jl attained was . 719 through 

Table 29 

Final Step of Stepwise Regression Analysis: III 

Criterion: Completion Time I 
(Step 3) 



Regression 




Selected 


a 


Factors 


wStati sties 


Measure s 


Variable 


(Sample N) 


(139) 


Criterion Used 


1 1 


Residual Variance 


1 15.641 


Predictor Entered 


7 


Residual S, D. 


10. 754 






Std. Error of Mean 


■ 912 






Multiple R 


■ 719 






Multiple R^2 


, 517 






Shrunken R 


. 510 






Constant (Intercept) 


153. 530 







Source 



ANOVA of Regression Analysis III 
SS df MS 



F 

48. 12 



Regression 
Error 



16692. 92 
15611. 40 



3 

135 



5564. 30 
1 15. 64 



^Cf. Table 24. 

the joint contribution of unique variance from thre'^ predictors. This 

2 

translates into an R of . 517 (variance explained). The ANOVA results 
for this regression step was highly significant with an F of 48. 12, where 
jdf = 3, 135 and p<. 001. 

A summary of the complete stepwise regression for this criterion 
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is contained in TaVjle 30* The cumulative R ranged from . 680 in step 1 
to •719 in step 3. The other regression by-products are included in this 
Table: R , R » the b and B weights, and raw score regression equation 

Table 30 



Summary of Stepwise Regression Analysis: III 
Criterion: Completion Time I 



Regression Cumulative 

Steps R R^ 


Shrunken 


1 


. 680 


. 462 


. 462 


2 


.714 


. 509 


. 506 


3 


.719 


. 517 


. 510 


Variables Selected 


b 


Constant 


B 


. Final Step (3)* 


vV eight 


(Inte rc ept) 


Weic^ht 


Pred. Score 


-.930 




-.635 


Attit. 2 


-.687 




-. 217 


Writ. Time 


. 1 14 


153. 53 


. 089 


Regression Equation 
(Raw Score) 


Y = - 


-. 930X^ -. 687X^ 


+ . 1 14Xy 4 153. 53 



^Variables rearranged in rank order of their B weights- 

to predict the criterion ( completion time !)• As with regression analysis 
I/II, the predicted score and attitude measure (i. e, , attitr2) were selected 
as the major unique predictors of the criterion. Again, it is apparent that 
the predicted score variable ranked first in effectiveness, being 3 times 
better than attitude-2 and. 7 times better than the written time measure 
(i.e. , testing time). Again, noteworthy for predicting CBI criteria was 
the appearance of student attitude in the regression analysis, 

(4) Criterion 4: Pass/Fail I . The final step (^5) results of 
regression analysis IV, using pass/fail as the criterion, are contained 
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Table 31 



Final Step of Stepwise Regression Analysis: IV 

Criterion: Pass/Fail I 
(Step 5) 



Regression 




Selected 




Factors 


Statistic s 




Variable^ 


(Sample N) 


(139) 


Criterion Used 


12 


Residual Variance 


. 089 


Predictor Entered 


1 


Reerdual S, D. 


. 299 






Std. Error of Mean 


. 025 






Multiple R 


. 507 






Multiple r2 


. 257 






Shrunken 


. 235 






Constant (Intercept) 


1. 1 20 








ANOVA of Reg 


ression Analysis IV 




Source 


SS 


df MS 


F 


Regr es sion 


4. 10 


5 . 82 


9. 21 


Error 


11.85 


133 .08 





^Cf, Table 24. 



in Table 31, The maximum R attained was , 507 with the joint contribu- 
tion of five predictors. Thus, the criterion variance explained by this 
predictor set is represented by an g,'' of . 257. The ANOVA results for 
this regression step was highly significant with an F of 9. 21, where df = 
5. 133 and^<. 001. 

A summary of the complete stepwise regression for this criterion 
is contained in Table 32, The cumulative R ranged from . 430 in step 1 
to . 507 in step 5, The other regression by-products are also included 
in this Table.. Noteworthy among these indices is the B weight ranking 
of the predictor set of variables selected to predict the criterion of pass/ 
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fail (i.e., |)}).if»<» I of basic electronics). As with the previous three re- 
gression analyses above» the two top predictors of CBI pass/fail were 
the predicted score and attitude-Z • The value of statistically designed 
predicted scores and student attitude toward CBI were clearly demon- 
otrated in the above analyses. 

Table 32 

Summary of Stepwise Regression Analysis: IV 
Criterion: Pass/Fail I 



JRcgrcs sion 
Steps 


Cum olative 

R 




Shrunken 


1 


. 430 


. 185 


. 185 


2 


. 468 


.219 


.213 


3 


. 480 


. 230 


.219 


4 


. 496 


. 246 


. 229 


5 


. 507 


. 257 


. 235 


Variables Selected 


b 


Constant 


B 


Final Step (5)^ 


Weight 


(Intercept) 


Weight 


Pred. Score 


. 013 




. 398 


Attit.-2 


.014 




. 204 


Perf. Time 


. 009 




. 151 


Writ. Time 


-.003 




119 


Age 


-. 016 




-.111 



-1, 12 



egression Equation y = . 0 1 3X . + . 0 1 4X, + , - . OOSX^ - . 0l6Xi - I. 12 

(Raw Score) 4 6 8 7 1 



Variables rearranged in rank order of their B weights. 

b. Resume of Results 
The preceding results identified and described eight pre/on-going 
training parameters relating to CBI» including their interrelationships 
between each other and four select training criteria. The four criteria 
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were: achio vtMncnt (written/i.)tM'formi'ince), completion time, and j^ass/ 
fail incidence. The analypis consisted of tht; use of both simple; (I'^ear- 
BOn Product-Moment) and multiple ( Whe rry- Doolittle Test Selection) 
regression with each criterion. Noteworthy among the matrix of 66 
simple correlations were those with the criteria. In rank order accord- 
ing to the size of their correlations were these predictor variables: pre- 
dicted electronics score, electronics aptitude score, attitude-2 and atti- 
tude-1 scores. The predictor variable inte rco r relations were uniformly 
low except for understandable relationships between the electronics ap- 
titude score and predicted score (.79) due to the fact that latter is a 
weighted version of the former, and between the two attitude measures. 
Noteworthy among the four multiple regression analyses, which identi- 
fied the unique predictors for each of the criteria considered separately, 
are the following findings given in rank order of their effectiveness: (a) 
Written Test I: maximum £ = . 725; minimum number of predictors de- 
rived was 4: predicted score, attitude-2, education, and attitude-1; (b) 
ime to Complete I: maximum R - .719; minimum number of predictors 
derived was 3 : predicted score, attitude-2, and written (test) time; (c) 
Performance Test I: maximum R ~ . 665; minimum number of pre- 
dictors derived was 3: predicted score, attitude-1, and attitude-2; and, 
(d) Pass/Ikil: maximum R = . 507; minimum number of predictors was 
4: predicted score, attitude-2, performance (test) time, written (te st ) 
time and age. Besides these valuable insights into the factor s / relation- 
ships indigenous to CBI, the multiple regression analysis yielded an 
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oplimi/ocl rf,.r.:.s..un„ o,|u..tiun for operational uso to predict each of the 

four criteria respectively. Based on the leant squares linear re^re^idon 

analysis used, optimal wei,;ht3 -.re a.s.si,.M,ed each selected predictor such 
2 

that E. (criterion variance explained) is inaximi/cd with the leafit nut7i- 
ber of predictors for each criteria. 

VIII GUirFLINKS/RECOMMf-NDATlONS FOR OPTIMIZING CBI 

. The findings presented in the preceding Results and Analysis chap- 
ter addressed three broad issues on CBI: (a) replication of effectiveness 
(Cni^jj vs CBI^^j);(b) replication of effectiveness (CBI va CI); and. (c) 
factors/relationships unique to CBI. As stated in the outset of that chap- 
ter, and in accordance with overall project purposes, the ultimate focus 
of the data presented was to shape guidelines for optimising CBI op 
tionally and to provide recommendations for future exploration and 
search based on empirical experience with two CBI systems. This chap 
ter will address these two areas with references to and inferences from 
the obtained data. 

A. GUIDELINES FOR OPTIMIZING CBI: UTILIZATION 

It is apparent that the number of areas to be addressed regarding 
optimization of CBI is potentially infinite. Indeed, it is beyond the scope 
of this report to focus on all possible aspects of CBI optimization. The 
fore, the domain covered, and the degree to which any one area is con- 
sidered, is necessarily delimited by: the course and student sampling, the 
study procedures employed, the issues and their subtopics addressed, and 
the dictates of the findings generated. Inferences and extrapolations are 
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section i« ^^^^ j,,.noral .^^..cture u,,,,, rlyi"r, the proc.cU 

ins data an.tly-'i, ,f"^»>. thi« c-ov,,r« H"^ - Ken.'i-i<^ -u-oa, of in- 

tore .t: ^^^^'^'^''^ ...hir votnoni (writton/p^rfor- 

mancc)ancl '^'^0 tr.uninM (cf. i^gu^A); (b) trailing ef- 

fectiveness: ''^''\^^^^^^^\\o/op^niol^^ ^°^v,-ird Cl-^I (cf. i^B^c B). ^j,^,,, 
are con5;icU' '"'"''^ ^b^^^ ,j,.ca6 withi,^ vvhich are conveniently class- 

ified and piv^'^^cl ^ ^^^'^e^. ^^^^at catet,^^ies inclu,,inp: ^^^^dNvare (on-/ 
off-line); «''^'''''^V^,/"^S,^.ire; te^tware; ,-,mbient training-lear,,i^g en- 
vironment; ^^/^^^^Mty i.T-.p^'^'- Spinoff Issue C favors and 
relationship-'^ ^Icroos both the ^^her issues, and will therefore 
be treated ^i^^ not separately. It shom.j be noted that the 

( ' C V 

same source ^^o,^ y ^ data ^v^^ derived the Btudont. Since 

he is ultiinat'^n' ^^j.somer to be pleased and benefited, his per- 

formance. resp^>^^^^^ j,^^^tions are th^ -acid test- to be by a CBl 

system. Fr°'^ ^ ^^^^""^ ^^^r fipccti^^' the overall pnrpoe^ °^ <^Bl is to op- 
timiz<. indivi^^^M^ ^''^'^ipc to achieve ^^^^i.tial end re^'^l'^'' (student 
achievement/P'^l.^^^^^^'^^cv) ^^^.^^ mi^i'^^i^ing training ^^^ne and costs. It 
is to these '"""^'^J ^^g^ni'/.ati^"'-^l objectives that the follo,,i,,g 

guidelines a-^'^ ''""^y^^'^'^^tions arc directed. As ^r^uch as Possible the 
logic and ter^^^n^^ j ^^^^ulated for g^v^erali^-aUo^ to education at 



large besid^'^ /""^ U. 5- Arr,,y, 
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1, Trainini: Kffcu tivonoss: fUutlont AchiovonuMit/r^uforinancc 
The rcfiultrt stcniinin|; from Infiuo A p<*rt;iinecl to tho repHciition of 
CBI cu; compared to CI acrons a number of invotitij^Ationr.. The thrunt of 
these initial C!^>I Rtiulion watj, a fortiori, basically an inquiry ref.arcliiif. 
the feafiibility and viability of two CHI eyfitcrnn: coniputcv a.MfiitUod in- 
struction (CAT) and computer niana[^cd instruction (CMI) in tcachinp Army 
b^isic electronics fundamentalfi. Without any equivocation, the basic find- 
ings in the Artny'« initial CAl feasibility study, comparing CAI with CI, 
y^crc replicated across several interim and ci final summative evaluation. 
The findings were: that CAI students demonstrated equivalent or greater 
achievement, on average, than CI students and attained this in signifi- 
cantly less time. This result is impressive to training managers at larg'* 
and particularly to Army cost conscious decision-makers. The dividends 
on an investment in CBI promises both cost benefits as well as cost effec- 
tiveness. Thus, extrapolating from the study results, one may expect 
tb^t CBI students can achieve field productivity more quickly through a 
substantial reduction in training time, which is equated at the same time 
to greater cost savings for the service. Based on these replicated results, 
and the concensus from, similar studies elsewhere, the following global 
guidelines (G) are empirically well based and contemporaneous within the 
present state of the art: 
a. General 

oG-l:CBl techniques (CAI/CDI/CMI) should be extended 
to all course material meeting the criteria estab- 
lished for CBI. Particularly, the advantages of 
CMI as the most cost effective way to bridge the 
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oG-5: While money/time are external limiting factors 
to a more rapid development, implementation, 
and proliferation of CBU lack of advanced plan- 
ning or ingenuity to mold CBI to one's needs is 
tantamount to self-imposed limitations. Thus, 
optimum utilization of CBI, a priori, presup- 
poses early sound planning, not just in develop- 
ing a given course segment /module but, more 
importantly, in the overall management of the 
CBI project's objectives. It's axiomatic: CBI 
is potentially a something for everyone proposi- 
tion - but only if it is well planned and managed. 
It can't be turned loose and be expected to suc- 
ceed; it must be closely managed, supervised, 
and *'nursed". 

b. Specific 

Other selected guidelines relating to optimum utilization of CBI as 
derived from an analysis o£ Issues A/C considered jointly are presented 
below. Again, the focal point is training effectiveness of CBI as demon- 
strated by student achievement/performance. 

oG-6: The single most noteworthy result of the CBI cor- 
relational analysis was the cross validation of the 
predicted electronics score variable. As the first 
predictor selected in the stepwise regression an- 
alysis for each of the four criteria it dominated the 
test battery selected to predict each criterion. This 
argues strongly for the use of '4east squares" pre- 
dicted scores for optimum utilization of CBI. This 
has not been utilized in-house to date. Multiple 
linear regression maximizes the prediction of a 
criterion (R^) by optimally weighting a set of pre- 
dictors. Use of the Wherry-Doolittle Test Selec- 
tion technique expediently selects the least num- 
ber of variables yielding the highest multiple R^. 

oG-7: Two specific areas which invite optimization are: 
(a) the CBI instructional model; and, (b) the staff 
faculty board which decides on go/no-go for stu- 
dents in difficulty. The instructional model con- 
sists of many decision points requiring a criterion 
"rulc'^ for a determination of module go/no-go. 
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Statistically derived weights would establish opti- 
mized '^rules'' at certain critical points for more 
effective execution of the CBI instructional model. 
The staff faculty board is responsible for decid- 
ing the course go/no-go decision for high risk 
trainees. Juggling the many variables on a trainee 
would be greatly optimized and rendered more 
objective by means of statistically weighted scores. 

oG-8: Another noteworthy result stemming from the cor- 
relational analysis was the contribution of unique 
variance to the prediction of all four training cri- 
teria by one or both of the attitude predictors, 
particularly the attitude 2 measure. This meas- 
ure consisted of attitudes toward the CAI system/ 
conditions. From the results, it is apparent that 
student attitude toward CBI is important toward 
predicting overall training effectiveness as meas- 
ured by all crucial criteria. Therefore, due con- 
sideration to trainee attitudes must be given by 
a CBI manager if he is to attain optimum utiliza- 
tion of his CBI system. 

oG-9: Across the conduct of several studies, it was read- 
ily apparent that the majority of trainees were favor- 
ably disposed toward CAI (i.e., on-line instruction). 
Those who were ill disposed toward on-line instruc- 
tion tended to be the very lov.'est in aptitude. These, 
naturally, found excessive reading of text on a CRT to 
be difficult. Thus, to optimize training effective- 
ness for this student level, at least a two track in- 
structional model is indicated where the low apti- 
tude would be required (or permitted to choose) to 
take an array of off-line media under close tutor- 
ship of an instructor. The use of CAI for this group 
would be for support only (drill /practice). It is 
axiomatic: the high aptitude will succeed regardless 
of the methodology used; the lower aptitude levels, 
however, require all the '^edge** they can get to suc- 
ceed. 

oG-10: Overall, it should be emphasized that just as the 
"heart?* of the computer system is its software, so 
too the ^'hcarf'of a CBI system is its courseware 
and instructional model. Emphasis will be mis- 
placed in CBI to stress equipment per se or soft- 
ware to the neglect of courseware and its strata- 
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gies. Training effectiveness (student achievement) 
will suffer if course de vclopinent is rushed and poor- 
ly validated, or if the strategies are inappropriate/ 
inflexible to the trainee population. Thus, all ele- 
ments of CBI must be addressed if its utilization is 
to be optimized. 

2. Training Effectiveness: Student Attitudes /Opinions 
The results derived on Issue B pertained to student attitudes /opin- 
ions toward CBI. This was the second generic area of interest in this pro- 
ject; In contrast with the 10 guidelines listed above, those delineated be- 
low address more operational topic areas tailored to promote optimum 
utilization of CBI. In general, as noted in the above guidelines, the over- 
all finding stemming from the general- specific attitude results was that 
CBI was highly favored by students for training purposes. Further, in 
response to open ended questions, a number of substantive and construc- 
tive comments were elicited from ihe student samples. These were pre- 
sented and discussed in detail in the preceding chapter. Based on these 
results, the follov/ing guidelines are presented according to topic areas 



of emphasis: 



a. Physical Learning Conditions 

oG-llt In comparing CBI with CI. the topic of physical 
learning conditions received much student atten- 
tion. Both positive and negative aspects of CBI 
were addressed. Students are keenly sensitive 
to discomfort while learning under CBI, particu- 
larly during extensive use of on-line instruction 
(CAI). In order to counter negative attitudes to 
on-line instruction due to fatigue, allowance must 
be made for sufficient breaks away from the CRT. 

oG-12: A specific area of discomfort receiving moderate 
attention was the physical size of the student carrel. 
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While most CBI students liked the carrel milieu in 
general, the confined size of the carrel was noted 
particularly by the peer-learning group. This is 
understandable because under this mode of instruc- 
tion 2 students were delegated to a carrel origin- 
ally designed for 1 student. It is noted here to em- 
phasize the point that the design of carrels must take 
into consideration their potential future use. Peer- 
learning is highly likely to be used for certain types 
of course material. Flexible rather than fixed par- 
titions may provide an answer. In some situations, 
only desk/table partitions or no partitions at all may 
be indicated. 

Instructional Methodology 

oG-13: Besides physical fatigue by extensive use of CAI, 
the matter of psychological boredom from constant 
use of one particular teaching method was noted also 
by some students. It behooves the designer of any 
variation of CBI to vary the instructional media suf- 
ficiently in order to optimize instructional . effective- 
ness. It is immaterial whether these media are di- 
rectly interfaced with the computer; rather, it is 
helpful that they be varied in conjunction : 1 :^ CAI. 
The availability of media options for stuo^ ;eiec- 
tion will, of course, be the ideal. 

oG-14: Another area of student concern was the lack of 
flexibility to query the computer for information 
and repeat frames for review. Of course, with 
additional programming effort these capabilities 
are possible. Development of instructional programs 
w' should incorporate to some extent student control 
over the instructional process (i. e, , ability to back 
up to review frame s /material without repeating the 
entire lesson), 

oG-15: The speed at which students are processed through 
CAI type training is of concern primarily to the low- 
est aptitude students. Typically, these are poor/slow 
readers. If alternate non-verbal media are not avail- 
able allowance for this group must be made via more 
liberal frame time. The incessant "time outs'* serve 
only as a constant reminder of failure for slow stu- 
dents. This group needs strong reinforcement not 
fear of constant failure. V/hile this trades off time 
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for achievement, it is preferred over pressuring 
low aptitude students. This approach, in fact, 
forms the basis for Bloom's mastery theory of 
learning (in Herrscher &t Roueche. 1973) wherein, 
with time being allowed to vary, the expectation 
is that all students will eventually achieve mastery 
of behavioral objectives on criterion referenced 
tests. 

c. Instructor Support 

oG-16: It was never intended that CBI would replace the 
instructor. This myth still prevails and inhibits 
the expansion and acceptance of CBI, Only advanced 
and systematic public relations can dispel this wrong 
image of CBI. It is accepted that the instructor's 
role will change not be eliminated in CBI. He will 
be converted to a private tutor for those in need, 
leaving the burdens of teaching per se, record 
keeping, report generation (and other administra- 
tive tasks) to the CBI delivery and data processing 
system. 

oG-17:Due to the changed role of instructors, the inter- 
personal/social relationship between student and 
instructor has also changed. CBI appears tobe more 
aware cf the instructor's personal qualities. New 
expectations exist between the two. The relation- 
ship is far less adversarial and much more cooper- 
ative. The instructor is now accountable for indivi- 
dual students and not a "classroom" group. Thus, 
any lack of good instructor attitude will be more 
quickly sensed by students. Instructors should not 
be expected to make the quantum transition to CBI 
without undergoing a formal orientation on how to 
perform within CBI. The present "charm" school 
for conventional instructors should have its counter- 
part for CBI instructors. CBI can be a "dull" teacher 
and to be successful will require a new breed of dedi- 
cated and knowledgeable instructors. 

d. Student Motivation/Performance 

oG-18: The application of computers to training provided 
for the first time an opportunity for systematically 
applying a contingency management program of 
learning reinforcement. This would efficiently apply 
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laboratory proven schedules of reinforcement in 
real-time operational training. As is known, be- 
sides ratio and interval type schedules, the in- 
termittent reinforcement schedule is particularly 
most effective in shaping both motivation and per- 
formance. The present in-house CBI instructional 
models incorporate simple verbal reinforcements 
(good/great etc,) on a token basis. The proper use 
of known reinforcement schedules and other con- 
tingency principles would significantly improve the 
current instructional strategies, 

e. CBI Equipment 

oG-19: The image of a computer "crashing" and students 
waiting for hardware / soft\vare should be erased. 
Down-time is inevitable. Therefore, efficient back- 
ups must be planned, or the time savings accrued 
by CBI will evaporate • Instructor-managed training 
(x>mputer printouts/PI booklets etc, provided to stu- 
dents) appears to be a viable alternative. Needless 
to say, where self-paced materials existed prior 
to the arrival of the computer a built in fall back 
eystem is ready to be called up with few adjustments, 

oG-ZO:Some emphasis was given in comments received on 
the need for more equipment orientation prior to CBI. 
It cannot be assumed that many students have had 
CBI (most have not) or know how to type as required 
by keyboard entry. Adequate familiarity with the 
operation of all on- /off-line equipment is conducive 
to effective training. An orientation "course" with 
opportunity for drill /practice on the devices would 
be beneficial. 

f. Peer /Individual -Learning 

oG-Zl: Success with peer- learning (use of 2 students per 
car rel /terminal) as noted in this project strongly 
suggests its future use in CBI to be indicated. How- 
ever, it cannot be expected that carrels designed for 
1 student will accommodate 2, Further, it cannot be 
expected that instructional material designed for 1 
student is directly convertible to 2 students without 
some adjustments and vice versa. Advanced plan- 
ning to generalize instruction and strategics for an 
audience of 1 or more is indicated. 
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oG-22: A common area of agreement between the Peer/ 
Individual study groups was the value and need for 
graphics in learning. Use of verbal-text material 
alone is contraindicated for effective learning. The 
optimum amount of graphics necessary will vary, 
of course with subject matter. In this regard, the 
current innovations in computer generated graphics 
should be exploited fully. 

B. RECOiMMENDATIONS FOR OPTLMIZING CBI: RESEARCH 

The above guidcMnes for optimizing CBI were immediate derivations 
from the data results of this project. Thus, by definition, their scope is 
necessarily delimited by the bounc)aries of the results and analysis. How- 
ever, typically v/ith any emergent innovation such as CBI, there remains 
a number of gaps in information relating to systems and procedures which 
require further assessment. In the interest of extending the data scope <-»i 
this project to implications for foliov^-on CBI, the following recommenda- 
tions for research and evaluation are proffered, These are heuristic con- 
siderations for future directions of CBI based on findings and experiences 
in this project. Similar to the guideline format above, the following rec-- 
ommendations (R) will be limited to statements of focal areas suggested 
for further development /exploration: 
1. General 

oR-1: That a "road map" be developed to chart the long 
range direction of CBI v,^ithin the institution. The 
piecemeal approach used to date is subject to re- 
dundancy. This should be projected outward by 
5-10 years. Included should be consideration of 
both regional (dial-up) an well as dedicated site 
specific uses of CBI; the use of mini- computer 
networks for institutional traijiing applications as 
well as micro-processors for field/small unit 
training containing data tapes to be "dumped" on 
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central processors; the use of optical scan vice key- 
board entry; etc. Considering the broad needs for 
diverse applications of CBI a liberal attitude toward 
a variety of hardware configurations is more real- 
istic. The "road map" should provide for an evolu- 
tionary growth of CBI from simple to more complex 
applications so that in-house expertise can keep up 
with the proliferation process. 

oR-2: That both potential CBI courses and the three tech- 
niques of CBI (CAI/CDI /CMI) be evaluated and plotted 
jointly for optimum training/cost effectiveness. 
Rather than force courses to fit a given CBI configu- 
ration, courses should be evaluated to determine 
what CBI configuration would be most effective and 
cost effecti%'e for them. This decision, of course, 
would include what CBI "mix'' v/ould be optimum for 
for each course respectively. 

oR-3: That a formal selection/training program be developed 
to standardise the identification and orientation of per- 
sonnel. This will insure that good "drivers'* will be 
assigned to the various levels of a CBI program: i. e, , 
managers, developers, instructors and staff. If CBI 
is to succeed, it is imperative that it not only have 
a sound "road map" (5-10 year plan) and an adequate 
•Vehicle" (appropriate hardware / software /cour se- 
v/are) but also the most proficient and dedicj.ted 
•^drivers" available. Conventional instructors should 
not be expected to make the transition automatically. 

oR-4: That, subsequent to the required sunimative evaluation 
of major innovations to insure the total product meets 
certain minimum quality control standards and is 
cost effective, attention be focused on formative (pro- 
cess) evaluation of CBI. Initial research must be 
given to determine exactly what systems evaluation 
procedures /criteria one desires for his formative 
evaluation. Care must be given to reduce the number 
of data reports required to a bare minimum to avoid 
the "wallpaper" effect. One can be swamped with 
computer printouts for troubleshooting (diagnosing/ 
prescribing) course material. The thrust here is to 
maintain/improve the quality of instruction with each 
succeeding iteration of student samples by means of 
computerized data reduction of student performance. 
A simple consolidated set of generated reports must 
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be devised if it is to be used /accepted by staff per- 
Bonnel 

oR-5: That initial CBI applications serve as "test beds" 
for further applied research. It is unrealistic to 
expect tliat all potential uses of CBI can be imple- 
mented on the first iteration of CBI. With highly 
compressed time phase plans and limited person- 
nel resources the best one can expect is that one 
can get "a system" up and running with just a few 
basic components of CBI in an operational state. 
Other more sophisticated CBI processes should 
await maturation of the system and staff personnel. 
Trying to be too fancy initially runs the risk of 
sacrificing quality for quantity. It is a bad trade 
off. Instead, development of more advanced CBI 
subsystems as: formative evaluation routines (item 
analysis: difficulty, discrimination, validity); re- 
source allocation (for student queueing, media / 
equipnacnl availability) etc., is ideally suited for 
"test bed" research/development. In this manner 
•'a system" can be up and operational at the ear- 
liest possible time while'more advance applica- 
tions are "honed" to readiness and phased in at 
later stages. 

oR-6: That the application of multiple linear regression 
analysis be explored both for improving the pre- 
diction of overall CBI performance/success as 
well as adding statistically weighted "rules" for 
improving decision making within the CBI instruc- 
tional model. The "least squares" method of pre- 
diction offers an element of precision to expert 
opinion in matters of prediction. 

oR-7: That the optimum student to instructor ratio be 

evaluated for various aptitude levels. Experience 
indicates that the high/middle aptitude can be self- 
supporting in self paced instruction for the most 
part; whereas, the low aptitude student dispropor- 
tionately requires a greater amount of attention. 
Accordingly, seating arrangements, training sched- 
ules and other admini strati ve /logi stical factors 
may possibly be optimized, thus requiring fewer 
instructors to minister to greater numbers of 
students. 
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2, Specific 

oR-8: That research/evaluation be conducted to optimize 
the following specific topic areas derived from an 
analysis of CBI student comments and experience 
resulting from several investigations on CBI: 

o The design of a flexible student carrel to accom- 
modate more than one student (for peer instruc- 
tion); 

o The optimum length of a CAI (on-line) session 
to avoid fatigue/boredom; 

o The degree to which media must be varied to 
preclude fatigue / boredom ; 

o The capability of querying the computer on de- 
mand (in all variations of CBI) by the student 
for the purpose of: asking specific questions, 
repeating frames, reviewing selected material; 

o The varying of CAI frame time-out interval rel- 
ative to aptitude level: i. e, , giving more time 
to lower aptitude levels and increasingly less to 
upper levels; 

o The proper qualities (training /attitude / role etc) 
of a CBI instructor given his nevy tutorial rela- 
tionship v^ith individual students; 

o The application of contingency management prin- 
ciples (S,"£.*Ef; shaping behavior by approxima- 
tions etc.) to enhance student motivation/perform- 
ance via behavior modification; 

o The development of expedient /efficient back-up 
systems to down-time; 

o The judicious use of peer-learning to further en- 
hance the- cost effectiveness of CBI; 

o The expedient use of computer generated graphics 
to reduce the labor intensive efforts of current 
graphics development and further enhance the cost 
effectiveness of CBI. It should be exploited fully. 



118 



105 

IX SIGNIFICANCE/IMPLICATIONS 

The results of this project yielded evidence relating to strong 
empirical replication of the instructional effectiveness of computerized 
training. Such evidence is crucial in this infant stage in the global eval- 
uation of the effectiveness of computerized training. Such verification 
argues strongly for computer-based educa.tion as an alternative educational 
technique, or adjunct tool, cither as a valuable tutorial device (CAI) or as 
an excellent management aid (CMI). The high potential of CBI remains to 
be exploited more fully not only as a delivery system but also for its 
educational management uses. 

More specifically* guidelines derived from the findings of this 
project were tailored to provide operational CBI pernonnel with a select 
set of empirically based "pro*s and con's for optimi^-ing the use of CBI 
as it applies tor instructional dt- velopment: course operation; ambient 
learning conditions; student motivational factors; social factors in learn- 
ing; and, a number of other crucial matters of interest to CBI course 
administrators, instructional staff and trainees. Secondly, a select set 
of heuristic recommendations derived from the findings of this project were 
delineated to point a direction for further required research and evaluation 
areas which may bring CBI to greater fruition. The generality of the 
findings of this applied research project are manifold and significant not 
just for Tri-Service training but across the entire gatnut of civilian edu- 
cation as well. Given the solid positive results of this project, and simi- 
lar findings coming in from elsewhere, it now remains for the current 
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>: GLOSSARY 

In the conduct of this study the following definitions are used: 
o ANOVA: analysis of variance. 

o Author Lanr^uAgg : is the language required for authoring instruc- 
tional material, 
o CAI: computer assisted instruction; on line instruction. 
. ^ CBl: computer-based instruction; a generic term used to define 
several applications of computerized training; i. e. CAI, 
CDI CMI. 

o CBI (1): the IBM 1500 Instructional System, (special label), 
o CB! (2): the PLATO IV Computer-based Educational System 
(special label). 

o CDI: coiT.puter directed instruction; instruction is typically off 

line near the terminal with interactive input of results to 

the computer for guidance, 
o CMI: computer managed instruction; instruction is typically off 

line away from the terminal, 
o CPU: central processing unit of the computer, 
o CRT: cathode ray tube; a television like display device, 
o CTS: computerized training system; currently under prototype 

development in the Army, 
o Down-time: computer not available for operational use due to mal- 
function. 

o IC: instructor controlled training. 
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jncJ^"^ ^'^^"^^-learning rnode; in contrast to peer- Ic^r^^i^^^' 
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^ Sequence of machine instructions. 
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P-time : performance test time. 

Writ: written test score (Phase I/II respectively). 
Pe£f: performance score (Phase I/II respectively). 
Time : conipletion time (Ph2.re I/II respectively). 
Pa c s / Fa i 1 : succefis/failure (Phase I/II respectively). 
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Appendices A-D 

Achievement tecting for Phases I/II of basic electronics fundamentals 
ic repreeented by both written/performance tests contained in appendices 
A-D. Appendices A and C b.tg samples of the actual written/performance 
tests for Phase I; Appendices B and D are the instrwciion^il topic areas 
covered by the respective parallel tests for Pha.se II. 
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A 

PMASfc I writtf:n trst 

DO NOT NtA PK THIS BOO K I .£T 

D^^^CTlo^^s 



!• Each of the following:; cjaoslions or incomp:>!ctc statctvionts is followed by 
four (l) ]^ossiblc answers only one (1) of which is correct or clearly 
the best. Indicate your answer usinq an ADP pencil and by making a 
heavy black mark in the oval containing the ])roper letter on the answer 
card. 

2. Check the number of tlio item on the ADP answer card against the item 
number in the test booklet to insure the numbers correspond. Misplaced 
answers will be scored as wrong answers. 

3. Do not cross out a misplaced answer. Erase it completely. The machine 
will score partially erased answers as wrong answers. Two or more 
responses for a single item will cause the machine to score the item 
wrong. 

DO NOT MAPK THIS BOOKLET 
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DO NOT M A UK TH IS l^OO I £1^1^ J 
!• Tho valur ol (hr ri'sir.lor fihowu is 

A. 470 ohms, 1 O'!o tolerance 

B. 470 ohn'is, 5'vo tolerance 

C. 47 ohms, 10% toleranc e 

D. 47 ohmK, b% Ifjleraru e 



Z, To reduce the possibility of cquiprTient failure daring 0[)cration, 
the repairman s}\oald 

A. familiarii'.e himstilf with the specific defects of the equipment 

B. maintain the equipment after a breakdown to prevent stoppage 

C. prevent breakdown by the location and repair of defects 

D. perform preventive maintenance 

3. The quantity 5. 30K ohm.s can be expressed as 

A. 0. 0053 ohm 

B. 530 ohms 

C. 5, 300 ohms 

D. 530, 000 ohms 

4. A shorted resistor in a series circuit containing three cquil resistors 
results in an increased 

A. applied voltage 

B. total current 

C. total resistance 

D. value of the two remaining resistors 

5. In the circuit shown, an open fuse would be caused by 

A. a shorted lamp L2 

B. a shorted resistor P 1 

C. an open lamp LZ 

D. an open lamp U 
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C. m.kc c,.r,,u„ u,e =h-,n,i, p„,„,r L, ' 
D- co„„ecc U,c „„..ccr on ,,orie« wit,, {ui ci.cui, 

7. A chanein, current in a coi, ca>,.,e» w„.t uc.ion^ 

A. Self induction 

B. Steady counter emf 

C. Steady magnetic field 

D. Pure direct current to flow 

8. Three 24 ohm reqi<;fnvo 

total resistJceof ""-^'-'-Parallel, will h,,e a 

A. 6 ohms 

B. 8 oh 

C. 24 ohms 
D« 72 ohms 

9. During the positive alternation nf f 

voltage developed is the frequency cycle, the maximum 

A. effective voltage 

B. rms voltage 

C. peak voltage 

D. peak-to-peak voltage 

JrJi'r/'""" = ^Ho„„ to „gK. 

A. Swl tch A 

B. Switch B 

C. Switch C 
D- Switch D 
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H. The ability of a .notorial to conduct muKnctic linof; of fovc^ 



ifi termed 

A. relativity 

B. conductivity 

C. retentivity 

D. permeability 



12. When all the- 1 ;,np« arc- of oc,ua) ro.iMancc. how doc-s thoir 
bri,;htnt;ss coinpai-e in the circuit whown? 



A. Lamp A will be briglitcr than lam]! H 
n. Lamp A will ho as bri.uht as lamp B 

C. Lamp n -.vill bo brijihtcr than lam]) C 

D. Lamp A will ho as bright as lamp C 



13. 



s^'houkl'o" resistor El. a repairman 

should connect an ammeter between points 



A. A-E 

B. B-C 

C. D-B 

D. E-D 



14. What effect is produced when a soft iron core is removed from an 
electromagnetic coil? 

A. Magnetic field and conductance increase 

B. Magnetic field and conductance decrease 

C. Magnetic field increases and conductance decreases 

D. Magnetic field decreases and conductance increases 
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Thcr aiu(>urU c^f power r(>n»;nin<»(i hy a 10 olun rfsifitor wiih a 
curi oMt of ,* iittipt'iM'M flowiii); Ihrou^^h it i r. 

A. 5 watts 

B. 2 0 watt« 

C. %0 Nvatt.s 

D. 200 waits 

If j<!Hit;tor J\ 2 ojHWi.s, the hrilliancM* of the li|;.ht bulb will 

A. increaBc 

B. remain unchan[',ecl 

C. decreaiJc 

D. fall to 7.C1-0 



V/hon cutlinj:; heavy p,au[;e wire a repairman should use 

A. lon^;-noc;ed pliers 

B. diagonal pliers 

C . s i d c - c ul t i n f pliers 

D. dykes 

To prevent the indicating needle of the voltmeter from moving 
in the v/rong direction when measuring d-c voltage, a repairman 
should 

A. start with the highest meter rr.nge available 

B. remove the circuit ]:)Ower before making the mcasviremejU 

C. observe the correct polarity with the meter 

D. start with high range, then go to a lower range 

The quantity 0. 03 ampere may be expressed as 

A. 0.00003 milliampere 

B. 0. 0003 milliampere 

C. 3.0 milliampere 

D. 30.0 milliampere 

Which resistor in the circuit shown will have the greatest 
amount of current flow? 

A. 
B. 

C. R3 

D. R4 
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What typi^ of readin); on .m oIuvh^um* would indicate an Ojx'n 
refiistor '> 
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A. Infinite 

B. Infinitt\ thrn gradually docrcasinj^, to /x'ro 

C. Infiniti', tluMi r,\d n,i 1 ly doc rea i nj.; to uulir.calo 

D. Zero 

22, The total aj^jdied volt.i[',c in the circuit shown is 

A. 25 volttj 

n. 30 voltr, 

C ^10 volts 

D 70 volts 



23. When working; with hif^h voltage electronic equipment, which 
procedure is NOT a safety precaution? 

A. Approaching; high voltaj^e with hack of the hand 

B. Grounding repair personnel to the equipment 

C. Removing rings and identification tags 
Keeping one hand in a pocket 

24. To dissipate ;iOO watts, the resistance of the bulV) "A" when 
switch is opened, should be 

A. 2 ohms 

B. 100 ohms 

C. 200 ohms 

D. 400 ohms 



135 



Phanc II: WrittcMi Tcfit 
(Lc8((on Toi)ic Summary)*' 

Week 3 
, Lefl sonc 



Week 4 
Leo nons 



L- 


). 


VTVM TS-505D/U 


L- 


1. 


Filament Circuits 


L- 


2. 


Audio Frequency Gen. 


L- 


2. 


Diodes 


L- 


3. 


Intluctance Reactance 


L- 


3. 


R ectification 


L- 


4. 


Capacitance Char. 


L- 


4. 


Filters 


L- 


5. 


Cornpiitinf; Capacitance V^l. 


L- 


5. 


Triodea 


L- 


6. 


Capacitance Reactance 


L- 


6. 


Voltage Ampl. 


L- 


7. 


Impedance 


L- 


7. 


Methods of Bias 


L- 


8. 


Resonance 


L- 


8. 


ClAGses of Anipl. 


L- 


9. 


Filtc r 6 


L- 


9. 


Tetrodes 


L- 


10. 


Impedance Britlgc 


L- 


10. 


AF Power Ampl. 


L- 


1 1. 


Transformers 


L- 


11. 


Dir. 8t RC C oupl. 








L- 


12. 


Transfer Coupl. 








L- 


1 3. 


'J'ube Tester 



^Some MOS's week 3 only/Other MOS's - both week 3/4, 
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PHASE I PERFORMANCE TEST 
VO NOT MARK THIS BOOKLE T 

• DIRECTIONS 



Each of the following questions or incomplete statements is 
followed by four (-1) possible answers, only one (1) of 
which is correct or clearly the best. Indicate your ansvv'er 
using an ADP pencil and by making a heavy black mark in 
the oval containing the proper letter on the answer card. 

Check the number of the item on the ADP answer card against the 
item number in the test booklet to insure the numbers correspond. 
Misplaced answers will be scored as wrong answers. 

Do not cross out a misplaced answer. Erase it completely. The 
machine will score partially erased answers as wrong answers. 
Two or more responses for a single item will cause the machine 
to score the item v/rong. 



DO NOT MARK THIS BOOKLET 
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INTRODUCTION ^"^^ 

1. You iivr yo\ni\ to tako a performance test on identifyinf; resistor 
values and circuit a r ranfMirne nt s . Using the multimeter, you \vi]l 
measure resistance, voltage, and current. 

2. The entire test will corisdst of four problems. You have already 
completed the solderinL; problcni (Problem IV). Your total score 
will be the sum of the four problems which v/ill then be converted 
into Army Standard Scores. 

3. You will be graded on your performance. Perform each task 
according to classroom instructions you have received. 

4. All required equipment will be available at the test positions. This 
includes a circuit board, multimeter, iind leads, student diagj-am 
and work f>heet, ADP card and pcnciL 

5. If during the test you are not sure of wheit to do next, ask your 
administrator for assistance. Technical assistance will not be 
given to you in solving a step. 

6. You may refer any question to the Test Administrator after you 
have completed the test. 

7- Do not give any information conccrninp, this tost to another 

student. It v/ill cause your Army Standard Score to be lowered. 

8. Ample time (approximately 20 minutes) has been allotted for 

each problem. You should be able to complete all your problems 
in 60 minutes, if you work at a steady pace. 

PROCEDU RE 

A. DO NOT MARK TiJIS BOOKLET. It is only for your guidance in 
recording your r.nswers on the ADP card. 

B. Your examination will be performed with the circuit board, 
multimeter, and STUDENT DIAGRAM and WORK SHEET in 
front of you. The circuit board has been specifically wired for 
this examination and its test points and resistors are clearly 
identified; the symbols X and Y on the circuit board are used for 
test points and are independent of circuit polarities. Reconnect 
any wire you disconnect during the examination. 

C. At the administrator's signal, turn to the next paj^e and fill in 
your answers on your ADP card. 
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DO NO T MAPK THIS BOOKLET 
PROBLEM I 
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Upe the resistor color code. What ir, the value ojf resistor R8? 

A. lOOOK ohms 

B. 102 ohms 

C. IK ohms 

D. . 01 ohms 

If all the other repi^tors were placed with a wire, in what circuit 
arrangement (if any) are resistors P6 and P8? 

A. Parallel 

B. Scries 

C. Incomplete circuit 

D. Short circuit 

Use the resistor color code. What is the value o^ resistor R9? 

A. . 1 5 ohms 

B. 1 53K ohms 

C. . 01 S o?vms 

D. 1 500 ohms 

If all the other resistors were placed with a wire, in what circuit 
arrangement (if any) are resistors RZ and RIO? 

A. Incomplete circuit 

B. Parallel 

C. Serie.c 

D. Short Circuit 

Use the circuit analysis you made in STEPS 2 and 4. In what total 
combined circuit arrangement (if any) are resistors R6, R8, R 2. 
and R 3 0? 

A. Series - parallel 

B. Series 

C. Parollel 

D. Incomplete circuit 

Identify the test point? at which the multimeter Jead-^ must be placed 
to measure the total resistance of resistors R6. R8. R ?*. and RIO. 

A. Y8 - YZ 

B. Y8 - X8 

C. YIO - X2 

D. YZ-XIO 



SAFETY NOTE: BEFORE starting thi«; step, insure that your 
resistor circuit board is NOT plugged in to your power source. 



Use the tcrst pointf; you have just selected in STEP 6. What 
resistance reading is obtained with your multimeter? 

A. 0 - . OlM ohms 

B. ZOK - 30K ohms 

C. 40K - 4 5K ohms 

D. , 3M - . 5M ohms 

Identify the test points at which the multimeter leads must be 
^)laced to measure the total resistance of resistors R2 and R4. 

A. Y3 - Y2 

B. X2 - Y4 

C. Y2 - X4 

D. X8 - YZ 

Use the test points you have just selected in STEP 8. What resi 
reading ir, obtained with your multimeter? 

A. 2. 2K - 4K ohms 

B. 0 - 500 ohms 

C. 25K - 30K ohms 

D. 600 - 2000 ohms 

PROBLEM II 

Use the resistor color code. What is the value of resistor R4? 

A. . 01 5M ohms 

B. . 15K ohms 

C. 1500 ohms 

D. 151 ohms 

If all the other resistors were replaced with a wire, in v^hat 
circuit arrangement (if any) are resistors Rl and R4? 

A. Short Circuit 

B. Series 

C. Incomplete circuit 

D. Parallel 

Use the resistor color code. What is the value of resistor Rl? 

A. 2. 7K ohms 

B. . 27K ohms 

. 027 M ohms 
D. 2700 ohms 
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13, If all the other resistors were replaced with a wire, in what circuit 
arrangement {if any) are resistors R6 and RIO? 



A. Series 

B. Parallel 

C. Incomplete circuit 

D. Short circuit 



14. Use the circuit analysis you made in STEPS 1 1 and 1 3. In v/hat total 
combined circuit arrangement (if any) are resistors Rl, R4, R6, and 
RIO? 



A. Incomplete circuit 

B. Series 

C* Series - parallel 

D. Parallel 



15. Identify the test points at which the multimeter leads must be placed 
to measure the total resistance of resistors R4 and R5? 



A. Y2 - X5 

B. Y5 - X4 

C. X2 - Y5 

D. X8 . X5 



>. Use the test points you have just selected in STEP ] 5. What actual 
resistance reading is obt:>ined with your multimeter? 

A. . 2K " . 6K ohms 

B. 2K - 6K ohms 

C. • 02M - . 06M ohms 

D. . 2M - . 6M oh^ns 

. Identify the test points at which the multimeter leads must be placed 
to measure the total resistance of resistors R4, R6, R8, and RIO, 

A. Y9 - XIO 

B. YIO - Y4 

C. X4 - Y)0 

D. X9 - YIO 



. Use the test points you have just selected in STEP 17. What actual 
resistance reading is obtained with your multimeter? 

A. . IK - • 2K ohms 

B. . 02M - . 025M ohms 

C. • OlM - . 018M ohms 

D. . 21K - . 27K ohms 
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Phase II: Performance Test 
(Lesson Topic Summary} 



V/eek 3 Week 4 

Practical Exercises Practical Exercises 

a 

L - 3. Inductance Reactance L-4. Power Supply 

L -7. Impedance L-6. Triodes /Voltage AmpL 

L -8. Series R esonance L-8. Bias/Class, of Ampl. 

L -9. Filters L-12. Power Ampl/Coupl. 

Transformers L-13. Voltage Resistance 

Oper. Cks. 



^l^= Les 



son. 
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Appendices E-F 

Attitude testing for the IBM {CBI^jj)and PLATO (CBI^2)) study groups 
is reprcfiented by two questionnaires contained in Appendices E and 
F, respectively. Each questionnaire consists of two parts. 
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IBM SYSTEM QUESTIONNAIRE 
DIRECTIONS 



This is not an information test. Therefore, it has no right or wrong 
answers. Rather, we are interested in your frank opinion of the follow- 
ing statements. The results will be used to find new ways to improve 
electronics training at the Signal School. 

PART I , 

In this part of the questionnaire you are asked to compare computer 
assisted instruction (CAI) with conventional instruction (CI), familiar 
to you as the instructor /text type of training which you had in high 
school, on 1 1 areas of general interest. 

Please answer by circling the letter next to that alternative which 
beet expresses your opinion on each of the following 11 statements. 

PLEASE REMEMBER 

CI = Conventional Instruction 

CAI = Computer Resisted Instruction 

1. I can learn new material 

a. much better with CI (Conventional Instruction) 

b. somewhat better with CI 

c. about the same with CAI or CI 

d. somewhat better with CAI (Computer Assisted Instruction) 

e. much better with CAI 

2. I can retain new material (i. e. , forget less) 

a. much better with CI 

b. somewhat better with CI 

c about the same with CAI or CI 

d. somewhat better with CAI 

e. much better with CAI 

3. I think instruction can be tailored to suit my training needs 

a. much better with CI 

b. somewhat better with CI 

c. about the same with CAI or CI 

d. somewhat better with CAI 

e. much better with CAI 
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When classroom difficulties arise, I am assisted 

a, much better under CI 

sornewlhit bettor under CI 
about the same under CAI or CI 

d. somewhat better under CAI 

e, much better under CAI 

The sequence of instructional material is 

a. much better in CI 

b. somewhat bettor in CI 

c. about the same in CAI and CI 

d. somewhat better in CAI 

e. much better in CAI 

My attention is kept 

a. much better in CI 

b. soinev/liat better in CI 

c. about the same in CAI or CI 

d. somewhat better in CAI 

e. much better in CAI 

The learning atmosphere is 

a. much better in CI 

b. somewhat better in CI 

c. about the same in CAI or CI 

d. somewhat better in CAI 

e. much better in CAI 

My training time is used 

a. much better with CI 

b. somewhat better with CI 

c. about the same with CAI or CI 

d. somewhat better with CAI 

e. much better with CAI 

My interest to learn electronics can be stimulated 

a. much better with CI 

b. somewhat better with CI 

c. about the same with C^I or CI 

d. somewhat better with CAI 

e. much better with CAI 
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1 0. I get tired of training 

^ 132 

a. much faster in CI 

b. somcwluit faster in CI 
about the same in CAI or CI 

d. somewhat faster in CAI 

e. much faster in CAI 

1 1. Overall, my opinion is that 

a. CI is much better than CAI 

b. CI is somewhat better than CAI 

c. Both are about the same 

d. CAI is somewhat better than CI 

e. CAI is much better than CI 

PART II 

In this part, you are asked to express your opinion on statements re^ 
lating only to CAL Circle the letter next to the alternative that be<;t ex- 
presses your opinion. Additional space is provided for any cpmments you 
desire to make. Please be as specific as possible in identifying the part 
of the CAI material to which your comments refer (i, e. , week of instruction, 
lesson topic, etc.) The Student Check List is recommended as an aid in 
specifying the CAI material. 

1. Sequence of the CAI material 

a. very good 

b. good 

c. neutral 

d. poor 

e« very poor 

Comment: 

2. Level of reading skill required by the CAI material 

a. very low 

b. low 

c. neutral 

d. high 

e. very high 

Comment: 

3. Style of the CAI material 



a. very informal 

b. informal 
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c. neutral 

forcnal J33 
e. very formal 

Comment: 

(WHERE POSSIBLE, SPFCrv I pcc„ 

, . " ™ VOUK COMMENTS , 

^« i hysical comfort of the C M 

area, lighting, etc, ) 

a. very good 
t>. good 
neutral 

d. poor 

e. very poor 

Specify: (type of discomfort/when etc. ) 

5. Amount of fati^^ue caused by CAI 

none 

b. very little 

c. neutral 
d- some 

a lot 

Specify: (type of fatigue/when etc.) 

6. Helpfulness of the imArro 

^ image projector slides 

a. a lot 

t>. some 

c. neutral 

d. very little 
none 

Comment: 
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(WHERE POSSIBLE. SPECIFY LESSON TOPIC(S) IN YOUR COMMENTS) 

. 7, Number of frariies presented in the CAI lessons 

a, very satisfactory 

satisfactory 
c, neutral 

unsatisfactory 
e. very unsatisfactory 

Specify: (lesson topic(s) v/ith too many/too few frames) 

8. Amount of material presented in the CAI frames 

a. very satisfactory 

b, satisfactory 
c* neutral 

unsatisfactory 
very unsatisfactory 

Specify: (lesson topic(s) having frames with too much/too little 
material) 

9. Background noiso in the room interferred with learning 

a. never 

b. occasionally 

c. neutral 

d. much cf the time 

e. all of the time 

Comment: 
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WHERE POSSIBLE, SPECIFY LESSON TOPIC{S) IN YOUR COMMENTS) 



10, Operating lun.seB of the ir-nage projector interferred with learning 

a. never 

b. occasionally 

c. neutral 

d. much of the time 

e. all of the time 

Comment: 



11, Did CAI tend to bore you? 



a, no 

b. yes 



Comment: 



I2p )3riefly compare CAI with CI. 



13, What did you like about CAI? 



14. What did you dislike about CAI? 
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PLATO SYSTEM QUESTIONNAIRE 
DIRECTIONS 



136 



This is not an information test. Therefore it has no right or wronp; 
ansv/ers. Rather we are interested in your frank opinion of the following 
statements. The results will be used to find new ways to improve future 
training by the computer. 

PART I 

In this part of the questionnaire you are asked to give your opinion 
about the 3 different ways the computer was used for instruction. Circle 
the letter next to the alternative that best expresses your opinion. Ad- 
ditional space is provided for any comments you desire to make. Please 
be as s pecifi c as possible in identifying the part of the lesson material 
to which your comments refer. 

A. Questions 1-4 relate to your reactions toward instruction pre- 
sented on the PLATO terminal in the DC fundamental lessons. 

1. Helpfulness of drawings or graphics on the computer terminal v^as 

a. a lot 

b. some 

c. neutral 

d. ve ry little 

e. none 

Comments : 

2. Number of frames (computer terminal pages) in the lessons pre- 
sented only on the computer terminal was 

a. very satisfactory 

b. satisfactory 

c. neutral 

d. un satis facto ry 

e. very unsatisfactory 

Specify: lessons with too many/too few frames. 

3. Amount of material presented in the frames on the computer ter- 
minal was 

a. very satisfactory 

b. satisfactory 

c. neutral 
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d* unsatisfactory 

e. very unsatisfactory 
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Specify: (Icnson having frame^ with too much/too little material) 

4. Sequence of the les son material presented on the compviter 
termincil was 

a. very good 

b. good 

c. neutral 

d. poor 

e. very poor 

Comments: 

B. Questionn 5-8 relate to your reaction tov/ard the lessons on SAEDA 
and First Aid Safety 

5. When proceeding through the lessons on SAEDA and First Aid h 
Safety, the coordination between the tv cassette player and the compuUrr 
questions was 

a. very good 

b. good 

c. neutral 

d. poor 

e. very poor 

Comm ents: 

6. Distraction caused by going to tv cassette player for instruction 
and back to the computer for testing v/as 

a. none 

b. very little 

c. neutral 

d. some 

e. a lot 

Comments: 

7. Would it have been helpful to have stopped the tv cassette player 
at certain segments throughout the lesson for questions on the computer 
before proceeding? 

a. very much 

b. some 

c. neutral ■« cr i 
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d. very little j 
c. not at all 



Comments: 



8. The length of the lessons were 



a. very sati £;f acto ry 

b. satisfactory 

c. neutral 

d. unsatisfactory 

e. very unsatisfactory 



Specify: (lessons, too long, too short) 



C. Question 9-13 relate to your reactions toward the leGSon on 
Troubl eslAOOt ing Procedures. 

9. When taking the lesson on Troubleshooting Procedures, the co- 
ordination between the sound on glide projector instruction and the com- 
puter questions was 



a. very good 

b. good 

c. neutral 

d. poor 

e. very poor 



Comments: 



1(X Do you feel that typing in the slide label was needed to coordinat 
the projector ins truct ior. witii the computer questions"-' 



a. not at all 

b. very little 

c. neutral 

d. some 

e. a lot 



Comments : 



11, Distraction caused by going to the sound on slide projector for 
instruction and back to the caiiputer for testing was 



a. none 

b. very little 

c. neutral 

d. some 

e. a lot 
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12, Would it have been helpful to have completed the lesson on the 
Bound on elide projector and then had all the questions at one time? 

a. not at all 
very little 
neutral 

d. some 

e, a lot 

Comments: 

13, The length of the lesBon was 

a. very satisfactory 

b. satisfactory 

c. neutral 

d. unsati sfactor y 

e. very unsatisfactory 

Specify: (too long, too short) 

14, Compare the type of instruction you received in the Troubleshooting 
Procedures lesson with the type of instruction you received in the SAEDA 
and First Aid & Safety lessons. Your opinion of the teaching approaches 

is that 

a. all questions at the end of a lesson are much better 

b. all questions at the end of a lesson are somewhat better 

c, botli are about the same 

d, questions throughout the lesson are somewhat better 
questions throughout the lesson are much better 

PART II 

In this part of the questionnaire you are asked to give your opinion of 
the PLATO terminal, sound on slide projector, tv cassette player and 
your work area. Circle the letter next to the alternative that best ex- 
presses your opinion. Additional space is provided for any comments 
you desire to make. 

A. Questions 1-6 relate to your reaction toward the computer terminal 

1. Difficulty using the computer terminal for instruction was 

a. none 

b. very little 

c. neutral 

d. some 

e. a lot 153 



ERIC 



Specify: (problem you had using terminal) 
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2. DiBrei',arclin[4 unfaniiliarity with the keyboard, operation of the 
keyboard was 

a. very difficult 

b, difficult 

c, neutral 

d. relatively easy 
e eacy 

Specify: (problems) 

.3. Distraction caused by the time delay of lesson material coming 
on the screen was 

a. none 

b. very little 

c. ncuti'al 

d. some 
c. a lot 



Comments: 



4, The images on the PLATO screen are 

a. very clear 

b. clear 

c. neutral 

d. some distortion 

e. very distorted 

Comments: 

5. Eyestrain caused by the terminal screen was 



a. 


none 


b. 


very little 


c. 


neutral 


d. 


some 


e. 


a lot 



Comm ents: 

6. Size of the letters on the terminal screen was 



a. very satisfactory 

b. satisfactory 

c. neutral 
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d. unsati sfactory 

very unfiatisfactory 
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Specify: (too small, too larp^c, etc.) 



Question 7-8 relate to your operation of the training, devices used 
other tluin the computer terminal. 

7* Operation of tlie tv cassette player was 

a. easy 

b. relatively easy 

c. neutral 

d. difficult 

e. very difficult 

Specify: (setting controls, loading, proceeding throof^h) 
8, Operation of the sound on slide projector was 



a , easy 

b, relatively easy 

c, neutral 

d, difficult 
very difficult 



Specify: (setting controls, loading, proceeding through) 

C* Question 9-11 relate to your opinion of your work area and surround- 
ings 

9. Amount of space in the carrels (working area) was 



a» very satisfactory 

b, satisfactory 

c. neutral 

d. unsatisfactory 

e, very unsatisfactory 

Comments: (too small, too large etc. ) 

10, Arrangement, of teaching devices in the carrels was 

a. very good 

b. good 
neutral 

d. poor 

e. very good 
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Specify: (cluttered, convenience of placement of terminal, sound on filide 
or tv cassette player, etc. ) 

U. Lighting at the carrels are 

a. very good 

b. good 

c. neutral 

d. poor 

e. very poor 

Comments: 

Quection 12 and 13 relate to other factors which might affect learning 

12. Background noise in the room interfered with learning 

a. none 

b. occasionally 

c. neutral 

d. much of the time 

e. all of the time 

Specify: (equipment noise of tv pl:5.ycr. n/s recorder, or terminal; voices, 
outside, etc . ) 

13. Amout of fatigue caused by computer training was 

a. none 

b. very little 

c. neutral 

d. some 

e. a lot 

Specify: (type c f fatigue ? wlien, etc . ) 

14. Express your feeling tov/ard a computer teaching system over 
much longer period of time (attention, learning, fatigue etc.) 
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Appcndiccfi G-IJ 

Summary of the pretest and post test data for ihe IBM feasibility study 
(CBI*,.) is cont<iincd in Tables 33 and 34. 
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Table 33 



Summary of Pretest Data 



Method 


M 




Aptitude 
Level 


M 


SD 


TV 


32. 40 


12. 80 


High 


49. 10 


10. 30 


IC 


33. 90 


14. 80 


Med 


30. 00 


10. 20 


CAI 


37. 00 


14. 1 0 


Low 


24. 30 


4. 90 


Total 


34. 50 


13. 80 
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Table 34 

Summary of Post Test Data 



Aptitude 

Method M SD Level M 

TV 57.40 15.20 High 74.20 3.00 

IC 55.70 18.90 Med 58.30 8.80 

CAI 60.20 14.40 Low 40.78 11.30 
Total 57. 8 0 16. 1 0 
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Appendix I 

The complete ntepwine rcgrcGaion analyseG for l^liase I. 

(TablcG 35 - 49) 
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Tabic 35 

Stcpwinc l^cRicssion Analysin: I 
Criterion: Written Test I 
(Step 1) 



Regression 
Factors 



Statistics 



Selected 
Mea sur es 



Variable 



(Sami)le N) (139) 

Residual Variance 117, 714 

Residual S. D, 10, 850 

Std. Error of Mean ,920 

Multiple R . 630 

Multiple R^ . 397 

Shrunken . 397 

Constant (Intercept) -8.800 



Criterion Used 9 
Predictor Entered 4 



Var iablc(:>) 
Selected 



b 

Coef 



Std, Error 



B B 
Coef Std, Error 



1, Pred, Score (4) .840 .088 .630 , 066 



Analysis of Variance 
Source SS df MS F 



Regression 10613.09 1 1063,09 90. 16 

Error 16126-82 137 1 17.71 
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StcpwiBo Hogre«.sion Analyfiis: I 
Criterion: Written Toht I 
(Step 2) 



Repression 
Fa c t o r s 



Statistic; 



(Sample N) 
Residual Variance 
Residual Sj_p. 
Std. Error of Mean 
Multiple B 
Multiple R''- 
Shrunken 

Constant (Intercept) 



(139) 
1 00. S&3 
1 0. 029 
.8 51 
. 699 
. 488 
. 485 
-43. 02 



Selected 
Mea Eures 



Variable 



Criterion Used 9 
Predictor Entered 6 



Variable(r,) 
Selected 



b 

Goof 



Std. Error 



2 B 
Coef Std. Error 



1. Attit-2 (6) 

2. Pred. (4) 



. 866 
.795 



.176 
. 082 



304 
597 



062 
062 



Sour c e 



Analysis of Variance 
SS df 



MS 



Regression 
Error 



1 3060. 45 
1 3679. 29 



2 

1 36 



6530. 224 
1 GO. 583 



64. 924 
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Stepwise R res sion Analysis: I 
Criterion: Written Test I 
(Step 3) 



Selected 

Statistic R Measures Variable 



(Sample N) 


(139) 


Criterion Used 9 


R esidual Variance 


95. 676 


Predictor Entered 2 


Residual S. D. 


9. 781 




Std. Error of Mean 


. 830 




Multiple R 


. 719 




Multiple R ^' 


. 517 




Sh runken R ^ 


. 510 




Constant (Intercept) 


-59.89 




Varia ble(f;) 


1) 


b B 


Selected 


Coef 


Std. Error Coef Std. 



Kejjrcfi.sioji 
Factor fi 



1. Attit-Z (6) .173 .325 .061 

2. Precl. (-1) . 718 . 085 . 539 . 064 

3. Educ. (2) 1.805 .639 .179 .063 



Analysis of Variance 
Source SS df MS F. 



RegrcfjGion 1 3823.51 3 4607.835 48.161 

Error 1 291 6.26 1 35 95.676 
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SlcinviKC Kt'f'.resr.ion An.ilysia: I 





Criterion: \V ritten 


Tent I 






(Step -1) 






RcgrcMjion 




vSclected 




Facto)s 


Stati Htic s 




Variable 


(Sample N) 


(139) 


Criterion Used 


9 


Residual Vari«ince 


91. 691 


Predictor Entered 


5 


Residual P, 


9. 7 31 






Std. Error of Mean 


.825 






Multiple R 


. 725 


• 




Multi plo K ^ 


. 52 5 






^Shrunken 


. 515 






Constant (Intercept) 


- 59. 000 






Variablc{5;) 


b 


b H 


B. 


Selected 


Coef Std. 


Error Coef 


Std. Error 


1. Attit-2 (6) 


.778 


196 .273 


. 069 


2. Attit-1 (5) 


.158 


102 .107 


. 069 


3, Pred. (4) 


. 708 


085 .531 


. 063 


4, Educ. (2) 


1.756 


637 .17'! 


. 063 



Source 



Analysie of Variance 
df 



MS 



Regression 
Error 



1 4051 . 12 
1 2688. 59 



4 

1 34 



351 2. 781 
94. 691 



37. 097 
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Table 39 

Stcpwir.c Regression Analysis: II 
Criterion: Performance Test I 
(Step 1) 
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Regression 
Factors 



Statistics 



(Sample N) ( 1 39) 
Residual Variance 1 14.207 

Residual 1 0, 687 

Std. Error of Mean , 906 

Multiple R . 600 

Multiple . 360 

Shrunken .360 

Const^int (Intercept) 2. 370 



Selected 
Mea EU7'e s 



Variable 



Criterion Used 9 
Predictor Entered 4 



Vririable{s) 
'selected 



b 

Coef 



;td. Error 



B B 
Cocf Std* Error 



1. Pred. Score (4) 


.765 .087 


. 600 


. 068 


Source 


Analysis of Variance 
SS df 


MS 


F 


Regression 
Error 


8801.115 1 
1 5646. 36 1 37 


880 1 . 115 
1 1 4. 207 


77. 063 
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Table 4 0 



StC!i>wi8e Kcj^ression Analysis: II 
Criterion: Performance Test I 
(Step 2) 



Kegression 
Factor s 


Statistics 


Selected 
Measures 


Variabl e 


(Sample 1^) 


(139) 


Criterion Used 


9 


Residual Variance 


1 03. 951 


Predictor Entered 


5 


Residual D. 


10, 196 






Std. Error of Mean 


■ .865 






Multiple R 


. 649 






Multiple }\ ^' 


. 422 






Shrunken P. ^ 








Constant (Intercept) 


-9. 630 






Variable{s) 


b 


b B 


B 


Selected 


C oef 


Std. Error Coef 


Std. Error 


1. Attit-l (5) 


. 355 


.093 .251 


. 066 


2. Pred. (4) 


. 720 


. 084 . 565 


. 066 




Analysis 


of Variance 




Source 


ss 


df MS 


F 


Regression 


10310. 16 


2 515-5.080 


49. 591 


JError 


14137. 34 


136 103.951 
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Table 41 

Stepwise Regression Analysis: II 
Criterion: Performance Test I 
(Step 3) 



Regression 
Factors 



Statistic s 



Selected 
Mea sures 



Variable 



(Sample N) (139) 

Residual Variance 1 00.994 

Residual S. D . 1 0. 050 

Std. Error of Mean .852 

Multiple R . 665 

Multiple . 442 

Shrunken r2 ,434 

Constant (Intercept) -23.530 



Criterion Used 9 
Predictor Entered 6 



Variab] e(s) 
Selected 



b 

Coef 



Std. Error 



B 
Coef 



Std. Error 



1. Attit-2 (6) 

2. Attit-1 (5) 

3. Fred. (4) 



448 
242 
711 



201 
105 

083 



. 165 
. 171 
. 558 



. 074 
. 074 
. 065 



Source 



Analysis of Variance 
SS df 



MS 



_ _F_ 
35. 690 



Regression 
Error 



1 08 1 3. 32 
1 3634. 19 



3 

1 35 



3604. 439 
1 00. 994 
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Stepwise Regression Analysis: III 
Criterion: Time I 
(Step 1) 



Regression 
Factors 


Stati Stic s 


Selected 
Measures 


Variable 


(Sample N) 
Residual Variance 
Residual S. D. 
Std, Error of Mean 
Multiple R 
Multiple 
Shrunken R^ 
Constant (Intercept) 


(139) 
1 26. 765 
1 1 . 259 
. 955 
. 680 
. 462 
. 462 
1 37. 050 


Criterion Used 
Predictor Entered 

- 


4 


Var iable{s) 
Selected 


b. 

Coef 


b B 
Std. Error Coef 


B 

Std. Error 


1.^ Pred. (4) 


997 


- .092 -.680 


. 063 


Source 


Analysis 
SS 


of Variance 

df MS 


F 


Regre ssion 
Error 


1 4937. 48 
17366. 81 


1 1 4937.480 
137 126.765 


1 1 7. 836 
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Stepwise Pcpression Analysis: III 
Criterion: Tinie I 
(Step 2) 
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Regression 
Factors 



Sta tisitics 



(Sample N) (1 39) 

Residual Variance 116.562 

Residual SJ}. 1 0. 796 

Std. Error of Mean . 916 

Multiple R . 714 

Multiple R^- .50 9 

Shrunken R ^ . 506 

Constant (Intercept) 1 63. 970 



Selected 

Mea sores 



Variable 



Criterion Used 10 
Predictor Entered 6 



Var iable(s) 
Select(!c) 



1l 

Coef 



Std . Error 



Coef 



B. 

Std. Error 



1. Atlit-2 (6) 

2. Pred. (4) 



682 
961 



189 
089 



65 6 



. 060 
. 060 



Analysis of Variance 
Source^ . ^5 . . . . -di. f'l . . Jll? 



R egrr n sion 
Error 



1 645 1 . 94 
1 585 2. 43 



2 

136 



8225. 970 
■116. 562 



70. 571 



169 



Table 44 



Stepv'isc Regression Analysis: III 
Criterion: Time I 
(Step 3)' 



Regression 
Factors 



Statislirs 



(Sample N) (139) 

Residual Variance 1 1 5. 641 

Residual S. D . 1 0. 754 

Std. Error of Mean . 912 

Multiple R . 719 

Multiple .517 

Shrunken r2 .510 

Constant (Intercept) 1 53. 530 



Selected 



Vari,-ble 



Criterion Used 
Predictor Entered 



10 
7 



Var iabl e( s) 
Selected 



b 

Coef 



Std. Error 



B 
Coef 



B 

Std. Error 



1. Writ-Time (7) 

2. Attit-2 (6) 

3. Pred. (4) 



114 
687 
930 



. 079 
rl 88 
. 091 



. 089 
-.217 
-. 635 



. 062 
. 06') 
. 062 



Source 



Analysis of Variance 
SS df 



MS 



F 



Regression 
Error 



1 6692. 92 
1 561 1 . 40 



3 

1 35 



5564. 308 
11 5. 641 



48. 117 
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Stepwise. llegression Analysis: IV 
Criterion: Pass/Fail I 
(Step 1) 



Regression 
J*^a c t o r p 


» J L 1 I 1 C r> 




Scil ecled 
Mea sur es 


Va riable 


(Sample N) 


I] 39) 




C riterion 


Used 


11 


Residual Variance 


. 095 




Predictor 


Entered 


4 


Residual S. D. 


• J \J (j 










Std. Error of Mean 


. 026 










Multiple R 


. 430 










Multiple 


. 185 










Shrunken 


. 185 










Constant (Intcrco]:!) 


560 










yariable(r;) 


b 




b 


B 


r3 


Selected 


Coc-f 




Std. Erroi 


Coef 


Std. Error 


1. Pred. (4) 


. 014 




. 003 


. 430 


. 077 




Analysis 


of Va. 


riance 






Source 








MS 


F 


R egres sion 


2. 950 


1 




2. 950 


31 . 078 


Error 


1 3. 003 


1 37 




. 095 
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Stepwise Regression Analysis: IV 
Criterion: Pass/Fail I 
(Step 2) 



R egression 




Selected 




Fa ctor s 


Statistics 


Measures 


Variabl e 


(Sample N) 


(139) 


Criterion Used 


11 


Residual Variance 


. 092 


Predictor Entered 


6 


Residual S. D, 


. 303 






Std. iCrror of Mean 


. 026 






Multiple R 


. 468 






Multiple r2 


. 219 






Shrunken R^ 


. 213 






Constant (Intercept) 


-1 . 070 







Variablc{G) Jb b. JB B 

Selected Gocf Sid. Error Coef Sid. Error 



1. Attit-2 (6) 013 .005 .185 .076 

2. Prcd. (4) ,410 .076 

Analysis of Variance 

Source SS df • MS F 



Regression 3.489 2 1.744 1 9.033 

Error 12.464 136 .092 
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Stepwise Regression Analysis: IV 
Criterion: Pass/Fail I 
(Step 3) 



159 



Kegrcssion 
FactorB 



Statistics 



Selected 
M e s n r e s 



Variable 



(Sample N) 


(1 39) 


Criterion 


Used 


11 




rvebiauai variance 


. 091 


Predictor 


Entered 


8 




jtxesioiiai o. JJ« 


. 302 










Std, Error of Mean 


. 026 










Multiple R 


. 480 










Multiple _r2 


. 230 










Shrunken 


.219 




■ 






Constant (Int . . ept) 


- 1 .-520 










Va riablc(s) 


h 


b 






B 


Selected 


Coef 


Std. Error 


Coef 


Std 


. E r r ( 


1, Pcrf-Timc(8) 


. 007 


. 005 


. 110 




. G76 


2, Attit-2 (6) 


. 013 


. 005 


. 103 




. 076 


3, Fred. {(4) 


. 014 


. 002 


. 425 




. 077 




Ana,lysi s 


of Va •' iance 








Source 


ss 




MS 




F 















Regression 
Error 



3. 676 
1 2. 277 



3 

1 35 



1. 225 
. 091 



1 3. 475 
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Table 48 
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Stepwise Regression Analysis: 
Criterion: Pass/Fail 1 
(Step 4) 



IV 



Regression 
Factors 


Stati sti c s 


Selected 
Measures 




Variabl e 


(Sample H) 


(139) 


Criterion Used 




11 


Residual Variance 


. 090 


Predictor Entered 


7 


Residual SjJD. 


. 300 








Std. Error of Mean 


. 025 








Multiple R 


. 496 








Multiple 


. 246 








Shrunken 


. 229 








C^onstart Qntorcent) 


- 1 . 290 








Variabl e(s) 


b 


u 




B 


Selected 


Coef 


Std. Error 


Coef 


Std. Error 


1. Perf-Time(8) 


. 008 


. 005 


. 137 


. 078 


2. V/ri.-Timc (7) 


004 


. 002 


130 


. 079 


3. Altit-2 (6) 


. 013 


. 005 


. 181 


. 076 


4. Prcd. (4) 


. 013 


. 003 


. 398 


. 078 




Analysis 


of Variance 






Source 


SS 




MS 


F 


Regression 


3. 919 


4 


. 980 


1 0. 909 


Error 


12.034 


134 


. 090 
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Stepwise Regression Analysis: IV 
Criterion: l^ass Fail I 
(Step 5) 



Regression 

Factors Statistic s 


Selected 
M <■■ a s u r e s 


Variabl e 


(Sample N) 


(139) 


Criterion Used 


11 


Rcsiducil V3.vi3.ncc 


A Q Q 


Predictor Entered 


1 


JKCSlOUJll 0. 1 


o o 








otci. iLti TOv 01 Meotn 










ivluiliplc K 










Multiple R'^ 


. 257 








Shrunken R ^ 


. 235 








C^nncit/^nt / 1 nt p t" r o nt^ 


- 1 1?0 








Variable(s) 


b 


b 


B 


Ik 


Selected 


Coef 


htd . ii^rror 


.V^ OCl 


Std. Error 






. 005 


. 151 




2. Writ Test Time (7) 


- . 003 


. 002 


-.119 


. 079 


3. Attit 2 (6) 


. 01 4 


. 005 


. 204 


. 077 


4. Pred. (4) 


. 01 3 


, 003 


. 398 


. 078 


5. Age (1) 


-. 01 6 


. Oil 


-.111 


. 078 




Analy si s 


of Variance 






Source 


ss 




MS 


F 


Regression 


4. 102 


5 


820 


9. 207 


Error 


11 . 851 ' 


133 


089 
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